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Research on Reaisouing and 

* ' I' 

^ Logical Thinking 

Introduction 

♦ • 

Definitions of reasoning or logical thinldng tend to be vague. Logicians 
generally provide a delinit:^on of logical thinki.ng that refers to "correct or - 
incoriject" thinking (Copi, 1961), or finding conclusions "on the basirs of 
reasons" (Angell, 196A). Such definitions iitiply an interest in discovering 
truth and validity. Psychologists' definitions reflect an interest in the 
processes of thought. For example, Nolen (1976) defines logic as thought that 
conforiTiS to so.k^g foriualized rules. It is the rules that are of concern , not 
the truth, or validity of the tliinking, 

Furthn.r, prsychologlsts roid philosophers have long recognized!' that a person's 
loglcfl thinking can be faulty. In keeping with Lhcir primary focuses, logicians 
have boon interested in dlJicovery and elimination of faulty rc'iasoning (e.g., ^nnis, 
1975), while psychologic tv«5 have been interested in studying the nature of correct 
and inco.rect responses (Evans, 1972; Falmagne, 1975; Nolen, 1976; Piagct, 1953, 

1963). ^ . 

Most psycl ological approaches to reasoning and logical thinking use ' 
traditional Aristotelian logic as a model or shorthand for the thought processes 
(Johnison-Laird, 1975). Althowgh some psychological research has been done on 
traiisitive assymetrical relc-tlonships (e.g., Rraincrd, 1979), disjunctive 
relationships (e.g., Roberge, & Flexer, 1979 '') and other logical forms , the greate: 
part of psychological rarsearch in the area has involved material implication 
(lUidar, 1975). In material iiutjlicj^ion, there ic an antecedent ytatciracnt v/hlch 
follows the word "if" and a consequent whil|li follows the word "then." The 
antecedent in reality may or may not be related to the consequent, but the 
implication states that it ca-inc:. he tlic cncc th^jt the an t'j cedent is true when 



tho consequence Is false (Copl, 1961). For example, if £ is the antecedent 

■> 

and ^ is the consequent, then aavs-implication statement would be of th*e form 

« 

•'If this is a £, then it is a 2,. The implication, therefore, would not be 
true, if there i^ a single case of p that is not a q^. There are other criteria 
which must be met. These will bo discussed later in this review. The^ importance 
of reasoning by implication has been discussed often in relation to mathema*:ical 
thinking and prohlem- solving (e.g., Brainerd, 1979; Brown, 19?9; Hadar, 1975; 
Roberge & Flexer, 1979(b)), scientific thinking (Ennls, 1975; Ennis & Paulus, 
1965), 

The differences between the focuses of the study 6f logic and the study of 
lo£;iccil thinking has led various researchers to warn of over-dependence upon 
the jBodels of logic to represent thought processes. For exan5)le, Evans (1972) 
questions the psychologioal relevance of logical validity to a person who is 
engaging in logical reasoning. Henle (1902) referred to deductive errors due 
to omitted, misinterpreted preioi.ses, an vinwillingness to perform the systematic 
thinlcing required, or the introduction of knox^ledge outside of what is provided , 
by the premises. Further, Br aine (19.78) made a distinction between the natural 
logic that people use in prepositional reasoning, and the standard logic of 
logicians. In Braine's conception of human thinking, inferential rules are ,. 
preferred to such tools of standard logic as truth tables, and axioms. Further, 
in Braine's scheme, connectives such as and , or, and other linguistic properties 
of propositions are closer to the usual or conversational meaning of the words 
than is the case in standard logic. On the other hand, Chapman and Chapman (1959) 
have proposed that people reason "illogically" by logicians' standards, but 
nonetheless systematically, while Woodworthand Sells (1935) proposed an "atmosphe 
effect" in x^/hich people were considered to evaluate conclusions of arguments 
according to the atmosphere of tho premises. For example, if a major premise 
contniucd the word "aJ.l," then a conclusion containing the word "all" woul d tend 



tc be conuldcrt'cl vnlld re};arclless"oC the logic involvt'd.' 

With the warnings regarding' using logical structures as model? of thought 
processes, in mind, it would be appropriate to turn to Piagct's theory of 
logical thinking (Inheldcr & Piaget, 1958; 'Piaget, 1953, 1963). Piaget made 
a distinction between logic and psychologic , lie suggested that the relationship 
between the two was similar in many respects to the relationship between pure 
logical notation, as symbolic of the structures^of thought. As Staudemeyer (1975) 
has pointed out, this puts a strain on the interpretatibn of symbolic opei^ators, 
and the assumption that subjects perform systematic evaluation of propositions 
or elements in much the same'way as logicians. * Although many have recognized 
the difficulty in interpreting Piaget's writings (Brainerd, 197,8; Flavall, 1977), 
the weaknesses in his logical models from a logician's vievrpoint have been well 
documented (Ennis, 1975; Parsons, 1960), Further, Smedslund (1970) discussed 
the circular relationshd.p between logic as a psychological variable and thought. 

Staudenmayer (1975) took the position that an adequate model of human thought 
would necessarily include the variety of interpretations that a person bases on 
his or^her owh environniental and background experiences. Johnson^Laird (1975)* 
suggested that no single logic would be adequate to explain human thinking, a • 
position also supported by Evans (1972). Although alternative logical systems 
are available (e.g., Freedle, 1977; Rescher, 1976; von Wright, 1957), psychologists 
generally seem to prefer the traditional Aristotelian models despite the ' 
criticisms leveled at thofee models for the ability to depict human thought 
processes. , 
Appr oaches t o the Study of Logical Thinking 

Falmagne (1975a) has divided the study of logical reasoning into two camps. 
The first- she identified with the Piagetian approach. The second . esscnLially ^ 
a paycholinguistlc enterprise, she called the propositional approach. Wason and 
Johnaon-Laird (19G8) had .^not or formula for splitting the psychological study 



of reasoning. Tlicy traced one lixie. of ^research to the. Wurzburg School at 
the beginning of the Twentieth Century and gestalt psychology, and the other 
to behaviorism with its *ocus on learning. 

The available literature in reasoning can be profitably organized a .third 
way. This way recognizes three types of approaches* The first would include 
those who focus on the interpretations f propositions and structure of 
standard logic. This approach is best represented by Wason and Johnson-Laird 
(1972). Then there is the Piagctian approach which posits a series of develop- 
mental stages in the development of logic. Finally, the information processing 
or memory approach blends tiome of the same tasks and characteriatics. of the , 
other tv;o with som unique 'features of its own. 

The logical structure approach . « The thrust of research with this approach has 
been to determhie the difficulty of reasoning using banic syllogistic structures 
(e.g., Eoberge, 1971). Further, there is an Interest in what influences make 
dealing v/ith logical arguments more difficult. F017 example, it has been shown 
rather consistently that modus ponens (JIP) is a relatively easy argument for 
adufls and children to "juclgc. Ge'ricrally, modus tollens ' (Ml) is the "next easiest 
followed by transivity (TR) , genial of the antecedent (DA), and affirmation of. 
the consequent (AC) , respectively (Iladar, 1975; O'Brien & Shapiro, 1968; Roberge 
1970, 1971; Roberge & Mason, 1978).. However, one study found iJlT the most 
difficult form v;hen ♦various permutations of negation in the premise were tried 
(Roberge, 1971). 

Among the influences that affect the use of formal reasoning princ4.plcs, 
negation of premises CRoberge, 1971; Roberge & Mason, 1978; Wason & Jolinson- 
Laird, 1972), and content of the premises (Mason, Bramble, & Mast,. 1975; Roberge 
& Antonuk, 1979; Wilkins, 1928), among othercharacteristics have been studied. 
Generally, it appears that subjects perform best on concrete content with which 
they arc familiar ar. long ao the prcmi.'ics make ccnsc. On the basis of theao 



flndlncs, tlie present study used fairly concrete and familiar objects i^ • , 
the premises. * '^'^ • ■ 

PJgRetian A pp roach to the otudy of loRic . Piaget's approach to logical thinking 
is embedded in his theory of the development of thinking. According to this 
tlieory, the child develops increasingly more mature thinking as it j;rQ;7s through 
a series of stages in which £ priori organic structures interact with environ- 
mental experiences. Initially, the child develops sensory-motor schemes which 
become the basis for more mature thought. Through the processes of assimilation , 
adapting or interpreting external stimulation to correspond to existing mental 
structures, and accomodatldh , adapting mental sturctures to the external stir.ali, 
the child's ability to reason develops. This development process continties 
through adolescence to the point at which formal operations have developed. At 
this final stage, the child can construct combinations of elements, isolate 
and manipulate variables, and form mental reprcseutationo of abstract concepts 
and events (Pitt, 1976). TIius, all possibilities - for a set of elements can be 
explored.^ ITie adolescent is not conscious of this system of possibility, but doe 
thorn naturally (Plage t, 1953).^ 

Contrary to the logical structure approach just discussed, Piagct was not 
interested in improving the structure o£ formal logic upon thinking and reason- 
ing. Rather, his interest was in describing the thought processes as they 
existed in reasoning on various tasks. Piaget used the notation of formal logic 
to describe these thinlcing processes (Piaget, 1953^. This may be one of the 

reasons that Piaget's models for logical thinking have been criticized as 

*^ ... 

illogical (Brainerd, 1978; Ennis, 1975; Parsons, 1960). 

The core of Piaget's formal operations stage at which complete logical 
thought becomes possible are 16 binary logical operations formed by the elements 
p and q (shown in Table 1), and the INllC group. Tlic INRC group is a group 
of operation:! in the maliicmatical Rcn«e and HiCcLs the four rcquirrii. jalifj of such 



groups; 1) cio' utrc - wlicn, element fl of tho group are co'mbined the result is 

ft ^ 

* 

always an element of the group;, 2) associativity when three elements are 

combined, the results are the sdmc no matter what order of combination If 

used; 3) identity - . there is an eleiaent of the group »th£^t does not change 

other elements when combined with them; and 4) inverse - for each element • 

of the group there is another element of the group that when combined' with 

it results in identity (Braincrd, 1978). The letters of the INRC group repre- 

sent, the following operations: 

Identity ; Application produces an equiv€>.lent representation of • 
the same proposition 
(i.e.. Il(p.q) V Cp-q) v (pttilJ = (piq) 
. . Implication Implication 

Negation: changes both signs and conjunctions 
(i.e.^N (p»q) • p v ir 

Conjunction Disjunction 

Reciprocity ; Changes the signs of a prppofiit;ion 
(i.e. Il(p-q) = P«g 
Negation Non-iiuplication 
of 

Reciprocal 

Iiupl'ication » 



Correlation ; changes the connections or conjunction in a proposition 
(i.e. C(pvq) = p'q 
disjunction conjunction 

According to Piaget all children pass through the stages of .development to 
reach formal operations. The speed or duration of this passage may be somewhat 
dependent on environmental factors, but the order will not change. Further, 
adults reaching the formal operational stage will be capable of performing these 
operations regardless of background or culture. However, they may be more able 
to demonstrate them in some areas than others (Piaget, 1972). On the other hand, 
thfc operaticnaliaation of formal operations io not as. evident as Piaget suggested 
once one goes beyond the tasks that Piaget and his followers have used (Martorano, 
1978), . . 



Table 1 



. Plaf.cl'a IC Mna ry pvop o r.ltlona f o rmod by p a nd ■ 

Notation • « Name of proposition 



1. p*q 

-2. p»q 

3. p»q^ 

A. p*q 



5. 
6. 
7. 

, 8. 

9. 
10. 
11. 
12. 
3 3. 
14. 
15. 



p.q 
p*q 

p q 
p«q 

p.q 

P'q 

p.q 



V (p»q) ' 

4 

V (p*q) 

V (p«q) 

V 

V (p-q) 

V (p-q) 

V ^^q) V (p q) 

V (p-q) V (p«q) 

V (p-q) ,v Cp«q) 

V (p^q) V (p.q) 

V (p*q) V (p*q) V (p^q) 



16, ^ [(p*q) V (p*q) V (p^q) v (p«q)J; or 0 



conjimctlon 

*■ 

/ ^ 'conjunctive negation 

Negation of Reciprocarl Implication 

Non- imp li c a t ion 

Equivalence (p^q) 

Affirmation of q ^ 

Affirmation of p , 

Denial of p ' 

Denial of q 

Nonreverse Jmplication 
Implicati^' iTi -Cp^q) 
Revcrr^ Implication (qr^p) 

ft. 

Disjunction (pvq) 
Nonconj unction (p/q) ^ 
Complete Affirmation 
Complete Negation 



In this Table and the remainder of the paper, the following symbols will be usc^: 



A line over a letter means negation (i.e.,"]^ should be read "not p"); the symbol i» 
means implication (p>.q should be read "p" implies q") , and the,*, symbol means the ^ 
conclusion follows, and should be read "therefore"; the symbol v means "or," and 
p V q should be read "p or q", finally, the symbol*" stands for negation. 
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Infoniitlon PX^ilP^A-^"^ ^.^^^ rvur^ory approncluis t: ^ situdy of; lo r.\c:> The 
infomation proccss'inc approaches, and there are several (eigo Corso, VJol; 
Simon and Newell, 1974), arc not as tied to the str'uctures and nditation of<. 'i 
formal logic. » However, certain representatives of this viewi^oint do rely on 
traditional logic to some degree (e.g., Biaine, 1978) • Simon <^967) has* 

argued that the. logic essential for this approach only depends upon "the ordinary 

* . » . . 

logic. of declarative statements" (p. 20), Some researchers using this approach 
try to identify Q^icient ^^Igorithms for problem-colving while others using the 
sanse approach may be interested in siiiailating and describing the" structures 
or incchauisins of reasoning. Therefore, inforination processing as it is discussed 
here represents a much lefis honog^neous approach than the first tx^o that x>rere 

p * 

discussed in this section. VJliat makes representatives of this group similar is' 
^thc ^4C(?u>pption thci human bcinj.s function on thoir environment in cereal /:ashlon 
using liiiiited. ''built in" coiaputational or opcrat jo;\a3 abilities which allow theni 
to scTlve problems of varying complexity. ^ 

Most ' Information processing approaches require sjome notions, of;, ir\put' of data, 
some central processing, storage and recall capabilities, and expressive or 
decoded "output," Braine t^Q^73) discusses four essentials in the central 
procesisiny and storage for logical reasoning, a. comprehension mechanism, a 
mechanism fgr .selecting steps, heuristics for planning and argument, and some f 
short- te:|^m--memory or "computing" space. Thus, some processing mechanisms in 
addition to logical .operators are required in going from reasoning to behavior. 
Case (1978) emphasized such things as practice, feedback, cue-highlighting, and 
the size of the space in working memory. Brovm andJ&e Loach (1978) referred to 
jDetarQf.mory as CL'>ntributing to the development of thinking. Othpr resonrcli^ers 
have focused on task analysis- (e.g*, Mayer, 1978; Trabaswyo ct al*, 1978),, the role 
of memory (e.g.; Potts, 1978), representation of different kinds of task: and 
objcctu (eg,, Mayer, 197G), c.^d a varlaty cf otlror incc.hani*jr.v3 ond proco:. ctis 
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(Erickson, 1978) # The present research Is more related to the inforraation • 
processing research which focusc^ on developmeutr of models to represent or 
explain reasoning and thinking, than those designed to ^-^roduce effeicent problem- 

9 ' 

fiolving. 

< « 

Comparison of the Three Approaches 

By far, the Plage tian approach haq been dominant in the psychological 
stu(iy of logib in the last forty^'years or so, partially because Piaget himself 
has been so piroductive a writer and researcher. Most developmental psychological 
yeeearch in this area begins with an affirmation, rejection, or query of some-' 
thing Piaget found or; wrote. Similarly, most critical reviews of the literature 
focus on what Piaget did, said, or omitted, mo /e than upon any other collection 
of work. • Therefore, the present comparison will necessarily focus disproportion- 
ately upon Piaget. ' ; , 

The first point of comparison between the three approaches ^is a philosophi- 
cal one. That is, each of the thr-ee approaches varies in its conception of 
logical thinking in people; The first group is routed in traditional logical 
structures, validity, truth functions, rSyllogisms such .^s. modus "ponens, modus 
tollens, aficl other concerns of traditional logic. Implicit in tniti approach is 
the assumption that cood logical thinking (i.e. valid thinking) is what humans 
should strive toward. That is, the goal of logical thinking is to be able to 
chain propositions in ways in which their application wi^ lead to logically 
correct reasoning. Not only is there a descriptive component to this rese-'rch 

» 

which assesses children's and adults' abilities to recognize, analyi^e or apply 
arguments under varying conditions, but also, there is a teaching interest 
•represented by these researchers. That is, through the use of training which 
may focus upon language structures, Venn diagrams, logical truth tables » pro- 
positional tasks, and so on, a person's reasoning can be made more logical. 

Further, the assumption that humans are not naturally logloal seems Impliclr. 



in this approach. 

This Is different from the other two approaches, Piaget's an^ Information 
processing, which seem to assume that there are existing logical structures 
which are revealed by research. Therefore, implicit in these approaches is the 
assumption that logical structures occur naturally in human thought. Further, 
there is a difference in tlie degree to which these resident structures resemble 
the notation system- and structures of traditional logic with Piaget's Jieing 
somewhat more similar to formal logic than the information processing view as 
It is broadly construed here. Although, as ind^r.ated earlier, many researchers 
who are here placed in the information processing category do research the 
processing of foimal syllogisms (Brainc, 1978; Mayer, 1978; Revlin & Leirer, 
1978), their focus tends to be on the thought proce.iJises that can be identified 
rather than the pcrforinance of valid thinking. 

Further distinctions between these approaches can be made on the basis of 
tasks (Danner & Day, 1977; Gelman, 1979; Wartorano, 1978; Trabasso, Isen, ^ 
3)olcc^;i, McLanaham, Riley, & Tucker, 1978),, degree to which validity of the 
logic is essential (Braincrd, 1978; Ennis, 1975; Piaget-, 1953;»Wason & Johnson- 
Laird, 1972), and the focus on linguistic matters (Evans, 1973; Roberge, 1978; 
Wason & Johnson-Lair4 , 1972). Piaget minimizes the Importance of linguistic 
factor? since the logical structures he proposes are organismic in nature and 
would therefore transcend language ana culture. 
The Present Studies 

The present studies were designed to investigate hypotheses related to 
the three approaches identified in the review of the literature. Only the 
hypotheses which have been tested so far will be reported here. Analysis of 
the data is continuing and will be reported on subsequently. 

Hypothesis 1: TJ-ere will be differences across ages in the kinds of verbal 
explanations made by chilclrcin and ndolscct-nts in judging lojylcal 
orguinents* 



11 

Hypotlicsls 2: The Class inclusion will be related to provision of 
correct judgments of the truth of logical arguments' containing 
Implication. 

Hypothesis 3: There will be an inverse relc t.ionship betvecm response 
time and correctness of reasoning which reduces as children reach 

r 

adolescence. 

Hypothesis 4: The class meaning of a logical argument as ref lectedj by 
subjects' explanations of thei- reasoning will correspond to fcjur 
components of material implication (p*q, p^q, p*q, & P'q)« * 
To test these hypotheses, two data collection efforts were mounted. Children 
and adolsecents who participated ranged in age from five to 16 years of age. 
Subjects were ^interviewed about their interpretations of propositions and 
logical arguments., and these interviews were scored using several standards. 
The design of these tv70 studies, including scoring, and standardization of 
the materials is^ described In the following section. 
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T.I * 

Methods 

Of the various approaches that have been used to study the development of. 
logic, each has ^^osed unique difficulties. For example, some have used formal 
syllogiems to c:q)lore children's reasoning. However, this kind of logic may not 
correspond Lo the processes of thinking (Braine, 1978; Henle, 1962). A rather 
thorough discussion of this is provided by Osherson (1975, p. 16-25). Further, 

•A 

much of this research has involved the use of group paper- and-pencil ej^aminations 
awd x-cquired rerpondontc to indicr.to whither the argur-.ent forsca are valid or not 
(e.g., Hadar, 1975; Robergo, 1970; T.obcrge & Mason, 1970; Shapiro & O'Ericn, 1970) . 
The group ndnanistercd papcr-snd-pcncil approach is useful for testing l.arge 
ntui.bers of cubjocta, but «.'oc£: iiot offer eu Oi-porf unity for, the researcher to 
cziplore the-, neaning of tho logic vith the child. It voul^l be difficult, for 
example, using this approach to dcterauinc v/hother subjects are giving correct 
ansvrers to logical arguv.snts beccjsa they hava maraorized an algorithm, have a 
partial understanding that is just enough to give the correct response, or 
completely understand the logic underlying the argument. This can be sho\m simply 
using the follov;ing syllogism: 

If all men are mortals 
and Socrates Is a man. 
Then Socrates is a mortal. 

» 

A child who is asked about the validity of this argument might respond affirma- 
tively because he or she understands the premises in any of the following ways: 

a) There are m'jn and there are tiiortalo. 

b) There are tnortals and there are men# 

c.) Kan must be mortals but luortalo do not have to be in\?.n. 
Siu?.c Socrates In n m.ni, ho mu'jt a].iJo be a ir.ortnl* 
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d) To be mortal implica being a man also. For Socrates 
to be a man he raust be a mortal. 

e) Men are mortals, and my father is a mortal, so Socrates must 
be like my father. 

Although all of the understanding© listed above would probably lead a child 
to say that the argument is correct, (c) shows the most complete miderstanding, 
and (d) is clearly incorre:t. The remaining understandings are not complete, 
although they would lead the child to respond correctly. 

Individual Interviews have been used to explore, children's understanding 
of logic with tonci succoso (e.g., Falmagne, 1975; Inhelder & Piaget, 1958; 
Kodroff & Robergc, 1975; Kulin, 1977).^ Interviews produce some problems, however, 
that are less troublesome V7ith paper-and-penciJ, group administered instruments. 
Thcr.o problems involve administration end scoring. Administration problems can 
be reduced by training interviewers not to influence the behavior of the rcspon- 
dent other than to encourage responses. Difficulties in scoring and interprecing 
interview data can also be reduced by training scorers and providing well-defined 
guidelines for interpreting and classifying responses. Therefore, such materials 
and techniques were developed for the present research, and will be described 
in the following sections along with tne subjects studied and the procedures 
used. 

DESIGN OF THE INTERVIEWS 

The interviews were designed to explore two different kinds of information. 
The first interview explored the child's understanding of the premises and 
conclusions "of syllogisms, the second explored the child's understanding of 
syllogisms in total. The two interviews were based on four syllogism forms: 
Modus Ponens (MP) (I^Q, P/. Q)., Modus Tollens (MT) (PiQ, Q/.P), Affirmation of 
tho Coiincqucnt (AC) (PoQ, Q.'. P), and Denial of the Antecedent (DA) (PJJQ, r.\Q). 



Truth table unalyals will revoal that >jr and m are valid arcuments while 
AC and M are invalid. 

The two forma are described in the following sections. Since the first 
form was designed to. compare understanding of premises individually and in 
the context of a whole argument, it was identified as the Part-Whole Form 
(Form PW). The second was only designed to study the meaning of the whole 
argument, and is therefore called the Complete Argument Form (Form CA) . 
FOBM PW . This fo pi was developed to explore relationships, between uiiderstanding 
of the supcrordinatc and subordinate clauses in the major premise and logical 
proceccing of the whole argument. As part of the understanding of the condi- 
tlonal implication, the child's underctanding of the implicit class inclusion 
relationship in the premises was explored. Further, the form was desigiied to 
explore two different content dimensions at the same time, concrete and verbal. 
Since there was a possibiHty that experience with a pan4ial presentation might 
influence a child's performance on the total argument, and vice versa, the 
interview was balanced for presentation of part first or whole first, and for 
the two content dimensions producing four parts as follows: 

Part I - Whole first, concrete. 

Part II - Part first, concrete. 

Part III - Wliole first, verbal. 

Part IV - Part first, verbal. 

Items were similar to the three-choice response paradigm used in other 
reasoning research (Ennis & Paulus, 1965; Hill* 1961; Robcrge, 1970). That is, 
subjects were required to state whether they thought the conclusion was true 
or invalid with the following three choices: Yco (it is true). No (it is not 
true),. Maybe (it may be or may not be true depending upon circumstances). How- 
ever, in the present interviews subjects were asked to give reasons -for their 
anm;r.r8. y. 
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In each concrete presentation the examinot used two trays (clear plastic 
18.0 era X 11.6 cm X 3.2 cm). One had ten small plastic animals in it (varylvlg 
sizes ranging in height from about 2 cm to about 5.5 cm and including one each 
of a lion, deer, antelope, rhinocerous, elephant, kangeroo, black cheeta, 
white polar bear, moose, and a white dog; the dog statue came from the standard 
1959 Stanford-Bine t Intelligence Test Kit.). The other tray (identical to the 
first) contained 12 green blocks (2.5 cm^) from the Stanford-Binet Kit. In the 
aniTiiial tray the dog was placed separately from the cluster of other animals at 
one end of the tray. Further, outside of the trays, the examiners, had an unpainted 
wood block of 2.5 cm x 2.5 cm x 8.0 cm, and a second dog identical to the one in 
the animal tray. Por the verbal presentation, cards (16 cm x 10 cm) containing 
drawings of a tree and a football (soccer ball) were used. Illustrations of the 
materials described here are in the appendix. " ^ 

The format of the whole-first presentation (Parts I and 11) for each item 
Is illustrated below using an example from the animals-dog concrete content. 
(Of course, the items were all presented in Dutci)) . 

b 

1. Examiner puts tray A before the subject and says : 

" IF ALL DOGS ARE ANDIALG (as vords are spoken, E pointy to dogs and 

then rest of animals). 

AND THIS IS A DOG (E shows S the statue of other dog that had 

been kept out of sight). 

THEN, I SHOULD ^UT THIS ' ^ 

WITH THE ANIMALS (E places dog in box near dogs). 

'\ 

a 

The reader can easily construct the ^remainder of the items by substituting 
the "cubes and blocks," "trees and plants" and "balls and round things" in 
the premloe of the four syllogism forms. Table 2 should be of some help here. 
^ The words the examiner says are in upp&r Case Jitters; instructions to the 
cJiamincr are in lower case. 
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A. DOES TllAT CONCLUSION FOLLOW? 

• If the child does not glva a standard answer, (yea, no, maybe.) E says: 
REMEMBER, YOU CAN ONLY SAY YES, \;iIICH WEANS IT mST FOLLOW: 
NO, WHICH, MEANS IT CAl^NOT FOLLOW, OR 
: MAYBE, WHICH MEANS IT MAY BE TRUE SOMETIMES, BUT YOU . HAVE NOT BEEN 
, TOLD ENOUGH TO BE CERTAIN. 
When S ^ives a s tandard answer , E asks : 

B. WHY DO YOU SAY THAT? ^ 
After S's answer, E continues; 

C. AzLL ME WHAT IT JIEANS W'YOV WHEN I SAY, 
ALL DOGS ARE ANIMALS. ^ 

When S responds, E asks: 

D. -ARE THERE M01«2 DOGS OPv ANIMALS? 

When S responclff, E continues, NOV/ TELL lffi WHAT. THIS MEANS: 

E. THIS IS A DOG (E points to larger dog in tray) , 
THEN, I SHOULD TUT THIS WITH THE ANIMALS. 

The following is an illustrati.on of an item from the part-first presentation 
(Parts II and IV). Again the animals-dog content is used for the illustration. 
4. Examiner puts tray A before the subject and says: 

A. TELL ME WHAT IT MEANS TO YOU WHEN I SAY, 
ALL DOGS ARE AiaMALS. j 

When S responds, E asks: 

B. ARE THERE MORE DOCS OR ANIMALS? 

Wlien S responds, E continues, NOW TELL ME IfflLAT THIS MEANS': 

C. THIS IS NOT AN ANIMAL (E holds up dog) 
THEN, I SHOULD PUT THIS WITH" THE DOGS. 

After S rceponds, E sayn, 
NOW LISTJ'IN TO THIS ONE. 
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•• i . 

IF ALL DOGS A?Z ANIILUS (E points to dogs then animals as words nre 

cpoUen) 

THIS IS rOT AN ANI>IAL 

THEN, I PUT THIS WITH THE DOGS, o 

D. DOES THAT CONCLUSION FOLLOU: 

If the child does not give a standard answer, (yes, no, maybe), E says; 

REIIEMBER, YOU CAN ONLY SAY YES, VmiCU MEANS IT MUST BE TRUE. - 
NO, WHICH MEANS IT CANNOT TOLLOV/. OR- ' 

MAYBE, WHICH MEANS IT MAY BE TRUE SOMETIMES. BUT YOU HAVE NOT BEEN 
"TOLD ENOUGH TO BE' CETITAIN. 
When Shelves n standnrd ansv/cr, E saye: 

E, \m DO YOU SAY TH/>T? 

Tho contcut by Qyllnc5t;;a r.-itrix in Tallo 2, ehova the scheniatic us6d • to . 
concti-JcL the ite:c. There ver'^. two itcr.-o ±n every part for each kind of 
content and syl.logisra. Since there were four syllogisms, and two kinds of 
content crossed in each part. There was a total of eight items in a part, and 
32 items in the whole interviev;. 

Table 2 * 

a) 

Content laatrix for contructing test items for Form PW. 

^ ' ■ 

Concrete Content Verbal Content 
Part - First Whole - First Part - First . Wliole -First 

liogs/ Cubes/ Dogs/ Cubes/ Trees/ Balls/ Tree?/ Balls/ 

Animals Blocks Animals Blocks Plants Round things Plants Round things 



MP 


1 


5 


1 


5 


1 


5 


1 


5 


MT 


2 


6 


2 


6 


2 


6 


2 


6 


DA 


3 


7 


3 


. 7 


3 


7 


3 


7 


AC 




8 


4 


8 


4 


8 


A 


. 8 






i\3 in 


cel?.i' oX 




■••cd to rcin'.to:. Iv 


' order 


items. 
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TllEN IT IS 

A. JJ then says: DOES THAT FOLLOW? • 

If the child docs not give a standard answer, E saysv • 
KEMHIBER YOU CAN OliLY SAY YES, VmiCll ME/WS IT MUST DE TRUE, 

NO, \micH means.it can:iot be true, or 

MAYBE, WHICH >1EANS YOU ILAVE NOT BEEN TOLD ENOUGH TO BE CERTAIN. 

B. When the child has given an answer, E asks: 

WHY DO YOU SAY THAT? 

From the arguments (MP, MT, DA, AC in two forms each), shape of the minor 
premise block (circle or cube), and color (yellow or green), a total of 32 
itcnis were constructed. v.Thls is Illustrated in. Table 3. As with the last 
troui, the items- vere ordered randomly in the interview. In addition, the 32 
Items were divided in half, sc that 16 items could be administered in .a}\ admini- 
stra'dou. This required the ch^ld to attend/for reriods of about 10 to 20 minutes 
usually about 12 LunuteR. 

Table 3 

Content Mccrix for forming Tost Items for Form CA^^ 



SylloglGm form 


circles 


cubes 




yellow 


green 


yellow 


green 


MP 1. 


1 


9 


17 


25 


2. 

• 


2 


10 


18 


26 


MT 1. 


3 


11 


19 


27 


2. 


4 


12 


20 


28 


DA 1. 


5 


13 


21 


29 


\, 2. 


6 




22 


30 


AC 1. 


7. 


15 


23 


31 


2. 


' . C 


16 


2/i 


32 



Niuiicrals In cellsxuced to randomly r rdar Items 



Numerals in colls used to randomly order items 

For research questions not included in the present discussion, half of 
the subJectG vore admi. ibtered tho items with the content of the minor premise 
placed separately fro. die remainder of the blocks on the carpet using the 
red tape' strip as a barrier. The rest of the subjects were shown the carpet 
with content of the minor premise ' included with the other blocks. • - 

' ■ • - * 

ADMINISTRATION ' ^ 

^ - * . 

The interviews were administered during the regular 'school day individually 

V . ■ ■ ■ 

by graduate students in developmental psychology from the University of Nijmegen. 

• . ■ i 

Interviews were recorded on cassette tape for later analysis. Examiners had 
specific 4.nstructions describing what to say. Copies of these instructions' 
arc included with the interviews in. the Appendices of this report. 

Children and adoleaccnts were interviewed indivldually/ln a quiet room 
outside of their regular classrooia. The setting varied slightly In each school, 
towcver, generally the examiner sat at a table directly across from the. child 
with the test materials arranged between them and thfe cassette tape reqjprder 

I 

(with built-in microphone) off to one side. 

Each cession was designed to take no more than 20 lainutes. Generally one 
or two parts of Form PW were administered during a single session. With Form 
C\, half the items (16) administered in a typical session, however, with older 
or more able subjects, occasionally^ all items could be administered within the 
20 minute sessioxi. The order of administration of the parts for Form PW, and 
the halves for Foirm CA was randomly determined. 

Each child's interview was preceded by a serieis of instructions and some 
practice examples. Tlie practice examples were devised to give the child some 
experience with the interview format and the use of the terms YES, NO and MAYBE 
format for responding. The practice problems did not contain any of the formal 
firguiiicnts used in the interview, Tlie practice cxani^les tmd accompanying 
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Instructions are included in tho Appendices. 
SUBJECTS ' • 

>vbjects for the studies described here v/ere students in nuirsery, 
primary, and secondary schools in the region of Nijmegcn, the Netherlands. 
Kindergarten, 2nd, 4th, and 6th grade children were randomly sampled as were 
students from the second year of secondary school and adiuinistered Form PW. 
Secondary school students wore selected in the ratio for llAVO, MAVO, and VWO 
at that level- Although it should be stated that at the particular secondary 
school which supplied the sample, a larger portion of the students go on to a 
wo program than is the case nationally^. ^ , 

Table 4 summarizes the charactcrif=:ticf. of the studahts. 

Tab].o 4 

Characteristics of ^Studtjnts who participated^ 



Grade 


Number, of boys 


Niimbet of girls 


Average age (yrs-months) 


Kindergarten 


5 


5 


6-0 


1 


7 


5 


7-0 


2 




5 


8-2 


3 


6 


6 


9-1 


4 


6 


6 


, 10-2 


3 


6 


6 . 


1 ' 


6 


>6 


6 


12-3 


Secondary 1 


9 


9 


13-0 


Secondary 2 


6 


5 


15-8 



Kiudcrj^artcn, sorond, fourt!^, rlxth f,rr?>-if{ end Secondary 2 siuc^r.nlr. raspcndod 

to I'orm tW, and first, thlr'J, flxth c^'-^dvrt;, aud Secov\*vlary 1 r/LiidcnUs rcijjponded 
to Fora CA* ^ v. 
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TABULATING At(D SCORING 

In this section, three stages In the proceccing of the data collected 
in the interviews are discussed. %he first is the transcription of the 
data from the cassette tapes to handwritten protocols. This was done to 
facilitate scoring, and to make a record of each intervi^. The second 
Stage involved the actual scoring of- the child's assessment of the syllogism. 
The third stage included the classifying of the child's verbal explanations 
Into catego/ies of verbal and logical explanations. 

Transcrlptdon . All interviews were Recorded using a- cassette tape recorder 
(Philips, N2215 automatic portable caffsette). The recordings were madn so 
that there would be axi accurate record of each interview. However, it was 
felt that scoring from the recorded* interview would be difficult because , 
responses to specific questions caiinot be addrecsed easily on a cassette tape. 
Also, when scoring, the tiwe required to play a tape in order to listen to 
one testing session would be greater than* the time nedded for reading d trana- 
cript of the cession if it were iu written form. For that reason, the children 
responses were transcribed. Forrrs were used which were designed to facilitate 
scpring.and at the sam^ time reduce- the amount of writing necessary to^ record 
the essence of the child's responses. 

For Parts I^and III of Form PW in which the whole syllogism was presented 
first, responses were transcribed using the following format for each item: 



A. 


YES 


NO 


MAYBE 




B. 










G. 


» 


« s 






n. 


P 


1 1 


Q 




E. 
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The transcription fornuit used with coch item of Part's II and IV of Form 
PW was: 



^ :. J 














Q 


-. . 


• • 






.D, YES 


NO 




. "MAYBE ' 


E. 


« 




• 4 



Note that in both formats, the letters correspond to the order of the 

questions acked, • L 

Transcribers used theso fo'nns in the, follovrlng vay.^ They circled the 
chlld^'s rcj?i)onfje to the question rhout vhether the Grgumoiit was true (YES, N0» 

* n . ■ ' ' 

I 

or MAYBE) , and to the class inclusion q-ucstion (subordinate (P) or . superordlnate 
(Q) ). For the remaining sections, the transcribers v/erootold to record In the 

J 

child's words what they thought v/e're the essentials of the child's response. 
They were told to omit any irrelevant verbalization, and to keep in mlad that 
they would be required to score the child's understanding of his or her response 
on the basis of what was written in the transcripts. Since there was thus ^an 
element of judgment required on the part of the persons doing the transcription, 
the question of inter- transcriber reliability was raised. This .question was 
investigated and will be discussed further in the section on reliability. 

The format for transcribing responses to each item in the Form CA interviews 
is shown below. 



A. YES NO MAYBE * ' 



. ' Ik 

a ' 

In the cuction laliclled "A" the transcriber circled yES, NO, or MA\BE to 
indicate the child's response. In section B, the essentials of the child's 
response were noted- Finally, in section C, 'the time elapsed in seconds 

' from vhon the examiner began the question to the moment when the chila 

responded with "YES," "NO," "MAYBE." The time was recorded using a hand-held 

"Stopwatch with a sweep second hand, and was recorded to 1/10 second accuracy. . 
The reliability of the timia& recorded by transcribers was studies as well as 
the reliability of the transcription and will be discussed later. 

* • 

Scorlup. In Form PW two questions in each item, and in Form CA one question in 
each item eould be scored directly. . That is, .the items for which the child •. 
was responding with a one word ans^'er that was either correct or incorrect 
• •• could be scored directly without further interpretation. ^ These were scored ^ 
using r key. An incorrect answer was cixditcd as "0" and a correct one as . . 
•'1.'' The total score vas the sum of the 1'g and O's. 

Cla ssification of Verbal Explanations . Two instruments were -used for classifying 
verbal tesponses. ' One, the Kodrof f-Roberge system, focused on categories pf 
verbal explanation based on techniques used with some success to classify 
children's verbal r.easoning (Antonak & Roberge, 1978;, Kodroff & Roberge, 1975). • . 
The second classification system (C-L) was directed more at the class and logical 
relationships expressed by the children. Copies of the forms designed for these 
two classification systems may be found in the Appendices, The specific instruc- 
tions given to the scorers are also Included in the Appendices. Scorers practiced 
the two systems until they felt that they were familiar enough 'with them to use 
them. Then inter- rater reliability was determined. 

Kod rofr-Roberge System . The K-R system used irt the present studies was 
adapted somewhat from the instrumentation of Kodroff and Roberge. To begin with, 

t 

tho orlj^i.nal system had six caLagoricfl of vnrbal bfih?vior. Tho first four 
CALcporlos were uoccl as propp55cd by Kodroff avul Robctce, They im:luded 
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varballzntlon tlGficl ts. (an inability to discuss the logic behind a deficit, 
e.g., "I don't kj\o\"), ii'emory dft ftcits (rcpeatine a premise incorrectly, losing, 
train of thought or becoming confused, e.-g., "Because this is a plant and 
thla ... I forgot."), ar bitrary eyplanatio ns (bringing in facts not given in 
the premises, e.g., "I had ^^og like that once and he was an animal"), and 
structural deficits (response Indicating an awareness of conditional logic 
but not adequate conditional reasoning, 3. g., "There ave dogs and there are 
animals."), patterned explanations , the sixth K-R category (response indicating 
that the premises are organized in a pattern, at least three terms in the item 
are included ("e.g., Dogs and animals. This is a dog and an animal"). The 
fifth category, conditional reasoninp. wai? chaiaged slightly from .the Kodroff- 
Koberge meaning. In the current system a response was only scored as condi- ■ 
tlonal reasoning if the rr.ftponce nhowcd coit"^. understanding of conditional 
reasoning that 'was iucorrect. The child wur.t have includ<:;d the words "If" and 
"then" in the response (e.g., "If this is a plant, then it must be a tree.") 
Two other chci?<;cs were made in the original version of the K-R scoring 
system for the present studies. One was the addition of a categojry called 
other for verbal explanaiilons which did not fit the other categories. The 
second was the "addition of a category entitled good logic . To be classified 
as good logic the response must not have fit in any of the other categories, 
must have shown mature Interpretation of the premises and the implications 
Involved, and th^ proper relationship between the superordinate and subordinate 
terms in the major premise (e.g., "Since all dogs are animals, there can be no 
dogs that are not animals. Therefore, this is a dog, so it is also an animal"). 

C-L Coding Form . The C-L coding form war, devised to identify the kinds of logic 
represented in subjects' responses. There were two kinds of ratings made of each 
response using this syrstom. Thci first hind wpn classification, the uecond war, 
logical^ relationships. 
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Classification relationships referred to the subordinate and super- 
ordinate characteristics of the tcrn\s in the prcml.e* For example, in the 
pre ^ise "if all trees are plants, trees are part of the group of things 
called plants. However, the child's vexbalization may reflect est understanding 
of the premise with trees and plants as separate and equal concepts, or some trees 
' as plants but othern not, etc. These kinds of relationships were coded on 
the class relationships side of Form C-L. To illuntrate, "If all trees are 
plants," may be understood by the child to mean any of the following: 

a) Tl\ere are equal numbers of trees and plants (P^ Q). 

b) There are luore trees thru plaats (r>Q) . '> 

c) There are Icjg trees thnu plants (1V.Q)# 

d) Trees and pl^iUts both c/Xj^b ac sep:.::c>te unrelated conaepts (^(^)* 

e) Trcon ciud plv/it's are pcirtr. ci th?. Vuv:q. conccr-t (r'Tj)). 

X) Sor.D trees arc plrntc a.y.l r.Ci.ir. pl-:;nU; arc ti zy..i» (C^jPo))* ' 



g) Trees are part of the larcer gruup of plants ^^^^J^^^)^* 

h) Plants are part of the larger group of traes (( ^ • ^ 

These categories of ipeaiiing formed the class relationship categories of the 
C-L coding form. 

The logical ratings on the other hand were based on Plaget's suggestions 
about the components of logical implication (see Eiinlr, 1975; luhclder h Piaget, 
1958) • To these were added a few categories that were to be important from 
the 16 binary propositions for-.rr^.d by P and Q (Inhelder & Piaget, 1958). The 
following categories were chcokcii when evidence for them could be found in the 
child^s response: 

a) V I The subordinate (p) clauno or tern is iuxiiuied. 

b) Q J The superordinate (Q) clause or term is affirmed. 

c) P" : Tlift ncgaticu of P in r.Xfir. ,cd. 
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J) Q : Tho nagntlon oi: Q is afJ:im)ed. 

e) p-kQ : Both P anO Q are rccoiiuiiiccl. 

f) P.Q : The negation of P tmd Q are affimied. 

g) P.Q : The negation of both P and Q are affirmed, 
li) P.Q : The existence of P without Q is affirmed, 
i) N(P,Q) : The existence of P without Q .is denied. 

j) ' Evidence of transitive reasoning Cfroiii V to 11 and R to Q) is 

.. given. 

Logical rclationohJ.po V7ere checked if they were implied by the child's 
rcnponso. For example, if the. response was "VHieu these aj.Ci dogs, these are 
axiimals because dogs arc anlTOalrs," the item would be ocoi.-^jd as P.Q (where. P 
represents the subordinate and Q the cuperordiuate cjitegorico in the promises). 
J!ut also, yincc it is iWillMM ^^^^ '^^^ ei-.-'.rt^ln are dots, or that dogs 
constitute a subordinnte group of th:^ cntogOj o£ Uiingr. l.ic\m as animals, the 
logical relationships P.Q^ and P.Q could be inferred. 

These kinds of inferences on the part of tho scorers required that the 
scorers be trained. Further, with such " procedure, inter-rater reliability 
should be established to demonstrate that different raters can rate a protocol 
with soma consistency, or to put it another woy, that different people can see 
the same things in a given protocol. 

The logical and the class sides of the C-L coding form contained a column 
for "other," which was used when a response could not be placed in one of the 
categories. Scorers placed a check mark in the appropriate column for each of 
the class and logical relationships that could be inferred from a response. 

Scorers were trained to use coding Form C-1. by coding two or three protocols 
together after they had read and discussed the procedures. Wlipn they felt that 
their ratings were agreeing substantially, they rated tho reliability protocols. 
Aiter reliability was established, the regnal ixUn; of th?. prol.ocwls A.'-to ijcoj-cd. 

I 
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RELlARlLm 

Reliability refers to thc^desrcc to vhich a test or procedure yields 
consistent inforn,ation. The present section discusses reliability estima- 
tions of -various types for each of the procedures used. The reliability of 
the transcription procedures are discussed first. Then the reliabilities of 
the total reasoning scores obtainable from Forms PW and CA are described. 
Following this, the Kodrof f-Roberge verbal classification system is discus.od 
from the point of view of reliability of the raters. Finally, reliability 
cstiuvations "for the CL coding Form are presented. These reliability studies 
were nja^^c" using the sarie three third year graduate students in developmcntnl 
psychology at che Catholic University of lUjiccgen, vho collected the date, 
then trin^cribcd and recorded it. Details of the reliability studies are 
roporlcd elsevTvero (Mason,' Haarn. Dinr.cm:.ns, Bion-rnr. van Duv.ren, 1979). 

A. PV.T.T AT^I1.TTY OF TrwV[[SCTaPT 3.0;:;S 

Foria PW - A random sample of five cassette tap^.s was chosen from a pool 
of 112 taped interviews, one tape from each of the five grades tested. Each 
cassette contained two parts of the four part form. Two of the tapes chosen 
contained parts I and II, the remainder contained Parts II and IV. The raters 
averaged about 12 to 15 words per response for the 120 responses they each 
transcribed on the five tapes. There were no . significant differences between 
the raters in the number of words they transcribed. Further, the average 
correlations between the three- raters for the number of words they transcribed 
ranged from .>7 to .99 and suggested a high degree of consistency between 
raters in terms of the number of words transcribed. 

Hoi/ever, agte.cment in the nur.l.ar of words docs not sugs-st agreemout in 
the meaning of the words or the words used. The d.gree to which the raters 
agreed unon the p.oaning of thoir trfaiccriptions van investigated by con^pniMnc 
Ibolr rulings using the U-R rad C-L Bcorinr, r.yr.f.on,.' , /ind ii; cli'.cu.ccd Ir.-.x in 
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tills report. In tef^ard to tho degree to which there, was agreeinont In the 
actual words used, and the order In which they appeared in the trantJcrlpLL', 
a cot^nt was made with each rater paired with every other one, Ai\ average of 
about 10 to 13 of the same words were written in the same order by each pair 
of raters. Further analysis revealed correlations between pairs of raters 
ranging from .86 to .99 suggesting a high degree of consistency. It was 
concluded on the basis of these data that there wad a high degree of consis- 
tency in transcribing from the recorded Interviews using the instructions for 
the raters that were given. 

Form CA - A raiidom sample of eight taped interviews was chosen from a 
pool of 54 interviews. Two intorvJ,ov;f? v/erc chosen from each of the first 
grade, third grade, fifth grade, and first year secoiidary school (seventh year 
of fornal education). Again, tha san^a three scorerfi v;ere used. T\70 transcribed 
an average of about 19 v;ordo per itcm> tljc third averaged about 12-5 wordf^. 
Although the difference betv/een the third and the first two was statistically 
significant (t<3</2 * 5. 13 and 4.26, respectively, d^f » 510, £<.001), this lack 
of agreement between one of the raters and the other two does not sugr^est that 
the shorter transcriptions were> necessarily less adequate than the longer ones 
for extracting meaning. This would be revealed in the application of the C-L 
and K-R scoring systems to the data if it is the case. 

The degree to which the number of words transcribed correlated among the 
three transcribers was investigated. Correlations ranged from .70 to .96 
suggesting that even though there was a difference in the number of words . 
recorded among observers, there was moderate to high agreement on the items for 
which more transcribed words were required to determine the meaning of the 
child's response. Similar correlation patterns were found for the correlaLions 
among pairs of raters. 

Ualng the hand held stopwatch, cich rater avori^gcd about 32.5 ceconds in 
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vo«po„se tl.e ,.e.=ure<l ior e«oh Ito.. There were no significant differences 
„o«d raters, a„d the response ti^ea correlated .96 between pairs of raters. 
That is, the data suggested that each rater ti.ed the various responses al«st 
Identically indicating a high reliability for this measure. 
B. RISLIABIUTY OF REASOMIHG SCORES 

Each form PW and AC «as capable of yielding a total reasoning score. 
This total score was computed by summing the correct responses «ES. NO. or . 
MAYBE) for the question about whether each argument was true. When the child 
was correct, a score of 1 was assigned to the item, and when incorrect, a 
ecore of zero was assigned. The total reasoning was . sumination of all the 
I's and O's. The internal consistency approach was used to investigate the 

reliability of this total score. 

TWO internal consistency formula, were used. _ the Spearman-Brown, and one 
Cronbach (1960) suggested as a more . adequate method. For Form PH, both methods 
yielded reliability esti.,ates of .88. For For,,, CA, both methods provided 
estimates of .93. U was concluded that Internal-consistency reliability was 
adequate for these instruments. 

C. REfclABILir; OF THE REVISED KODROFF-ROBERGE SYSTEM 

Since the Kodrof f-Robexge system is a method for classification of verbal 
responses to questions requiring reasoning, the reliability question with this 
system concerns the consistency with which different raters use the response 
categories. Raters made their ratings from the hand-written transcriptions 
of the taped interviews. Each rater used his or her own transcription since, 
it was felt that in a practical scoring stiuation, the rator would use his or 
^ own transcription. Furthermore, the transcribers were given the instrictions 
to only transcribe the parts of the child's verbal response that they felt 
were necessary to show the child's understanding of the reasoning principles 
it used. Therefore, U-« rater's clussif Ications o„ thi. and the C-1, coding 
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forma could be considered evidence of content validity of the tranr,cripts if 
the Inter-rater reliability were high. 

The determination of inter-rateif agreement with categorical data is 
somewhat more complex than simply counting the number of times t^^^o or more 
raters agree and- the number of times that they do not. Many of the problems 
involved have been discussed by Cohen (1960), Light (1971)., and Robinson (1957). 
Basically, the problems involve a distinction between demonstrating patterns of 
agreement versus patterns of association. The methods suggested by Light (1971) 
and Cohen (1960) v/ere used with the present data. 

For each of the Forms PW and CA, a tlircc dimensional matrix of agreement 
vjao constructed. There was one dimension for each rater. The eight categories 
of ratinf.c vera placed along each dimension to fonu f.n 8 x 8 x 8 cube containing 
512 "cells." Using, these cubes, coefficients of ai',reement were calculated for 
all three raters using Light's procedure (1971, p. 3G5-370) , and for pairs, of 
raters using Cohen's (1960) method- 

Form PW - The overall coefficient of reliability (Km) of the ratings given 

by the three raters was computed to be .7A wUh the Light formula. Inter-rater 

» 

reliabilities (K) were computed to be .75, .77, and .70, respectively, for 
pairs of raters* These reliabilities were considered moderate and were statis- 
tically significant (p4.05). It should be noted that there was somewhat greater 
agreement between raters for the responses of children who were younger (Kinder- 
garten and second grade) and those who were older (second year of secondary school) 
At those ages raters said the children seemed better able to express their 
understanding, oi lack of it. The fourth and sixth graders may have been in a 
transitional stage between more mature logic (or less), and between more (or Icon) 
mature cxprecyivf cibiHty. Thifi, of coursr, ia a broadof researoh qupsf.ton than 
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can be dJ.scu8S(;d hero.,, and will be the subject of later reports. However, \ 
it should be recognized that if at some ages chi3dren are not sure what they 
mean to say about their logic, or are not sure how to explain it, this could 
affect the consistency of those trying to rate what they say they mean. ' 

In addition « the percent of agreements between pairs of raters were 
computed. Tlicse rang. id between 78.13%/ and 83.75%. This was considered 

t 

substantial, and to reflect further on the consistency between raters. A 
total of 160 responses wa^ rated in the five tapes by the three raters. 

Form CA - The overall coefficient of reliabll:I.l;y (Km) for thp three raters 
was computed to be .70. For pairs of raters inter-rater reliability estimates . 
ranged from .^6 to .74 using Cohen's method. Further, the pairs of raters 
agreed on from 77.08% to 82.92% of the 240 responrses they considered. Again, 
these reliability estimates x/erc consnMcrei uodcrote, and seemed to be influenced 
by unclearncss of responces by the middle age ranee. 

The moderate reliabilities obtained for this form are slightly lower than 
those reported by previous users of the original Kodrof f-Roberge system. For 
example, using Cohen's method, Kodroff/and Roberge (1975) reported a reliability 
of .86 for a I pair of raters. However, their data were from children who were 
younger than those in the present studies (first to third grades). The moderate 
reliabilities obtained for the three observers in the present study suggest 
that researchers using the K-R system with a broad age range should not try to 
interpret small differences, especially among fourth to sixth graders, because 
such differences may not be reliable even if they do approach statistical 
significance. 

D. RELUBILITY OF THE CLASS - LOGIC SCORING SYSTEM 

The same three raters and tapes were used to study the reliability of the 
C-I. rv.ovlng r.yGto-,!!. Sine; Uio nvuubc.rs Invo.lvod vr.vc. sMnll (10 x-^vu, Lov Voxm PW, 

I 
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and 8 tapca for Form CA) , the dntn from the two were combined. Even so, 
there were not enough ratings in some of the categories, to produce dependable 
reliability estimates. However, it should be noted that these categories were 
not used with consistency by the three raters and although this contributed 
to the lower correlations in some cases, it does show a consistency among the 
raters. Tables 5 and 6 show the correlations between raters for the frequency 
with which they rated categories (with tape as- the unit of analysis (n = 18) . Also , 
shown in the tables are the number of times both raters in a pair used a category 
for the same I ipe. Generally, It can be seen that the categories that v;ere used - 
more frequently show higher inter~rater correlations, the exceptions being (P •= Q) 
in Table 10 and (P) in Table 11. One can conclude from these data that certain 
of the categories, f.otably (P), (P.Q) and (P. Q)^ from the logic ratings, and (P< Q) 

® 0, and(2?i2)^" class rat^-nj^s can be used with some confidence of reliability. 

/ 

Table 5 . . 

Correlations between raters for the frequencies that they used class categories, 
and the number of tap6s (n) in which each category was used by both raters for 
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Table 6 

Correlations between raters for the frequencies that they wsed locic categories, 
and the number of tapes (n) In which each category was used by both raters 
for the 18 reliability tapes. 
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V 

Summary 

The procedures outlined in. this section represent a fairly complex set of 
perspectives for the researcher to use in assessing children's reasoning. The 
procedures are not meant to be comprehensive. However > they do comprise a 
system which assesses verbal expression (K-R) , understanding of implication 
(C-L), and ability to reason logically (total score). It also assesses 
understanding of parts of conditional arguments, the arguments presented as 
^ a- whole, and understanding of the class inclusion aspects of implication. 
Further, it has been used with children ranging in age from five to 15 years old. 
The following section of this report addresses four hyi;otheses tt^sted using 
the methods and materials described in this section. 
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III 

Analyses of Data 



Study 1 

/ 

/ - • 

Hypothesis: There will be differences across 
ages in the kinds of verbal explanations 
made by children and adolescents ;tn judging ^ 
logical arguments. . ^ 

Intro duction ' . 

The importance of verbal explanations for the' understanding of children's 
reasoning behavior has been recogtxized in raathenmt'i<r^^ 

1979; Vergnaud, 1979), and more traditional logical reasoning tasks such as - 
syllogisms (Evans, 1972; Roberge, 1978; Wason, & Johnson-Laird, 1972). Piaget 
(1953, 1972) has suggested that at the stage of formal operations (early 
adolescence), reasoning with verbal symbols as abst:ract representations of^ 
concrete elements becomes more prominent. One would suspect, therefore, that 
adolescents' verbal explanations for 'their'loglcal thinking would be abetter 
reflection, of their actual judgments than would be the case with younger child- 

c ' 

rcn. 

The importance of the linguistic structure on the reasoning task has been 
recognized (e.g., Evans, 1972; Johnson-Laird, & Taggart, 1969; Roberge, 1978). 
Fot example, Evans (1972) reported that wording a conditional as "If then..." 
led to more correct response for MP than MT, while MT responses improved when 
the conditional was worded in th& "Only if ..>, then..." form. One of the 
ways of exploring the bases for this kind of finding is by asking subjects 
quer: Lions about why they gave the reasons that they did. This approach has 
been criticized by Ennis (1975), Brainerd (1978), and others. Basically the 
criticism deals with a lack of assurance that verbal explanations coincide 
with" the reasoning that takes place. Verbal ability depends upon api, vocabulary, 
practice in explaining, background experience, fort;,,nl learning, and other 
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jfactors which may or may not be independent of the simple judgment of an 

r 

argument as valid. , Further, there is a question about whether thinking is 
verbal, and can be explained easify using language. Another criticism can 
be raised about the experimenter's ability to interpret the verbalization 
of the subject in the c?orrect way. On the other hand, Evans (1972) has called 
for more ••thinking aloqd** procedures to analyze human thought and reason. 

The present stfudy attempted to reduce some of the previous criticism of* 
verbal explanation procedures, by using the Kodroff -Roberge (K-R) system for 
classification of verbal explanation. iJsing this system, Kodroff and Roberge 
(1975) found arbitrary explanations and patterned explanations prominent in a 
sainple'»of children in first, second and third grades of elementary school. Fur- 
ther, they found more correct reasoning with concrete than with verbal presen- 
tation, and MP appeared- less difficult than MT. Verbal deficits was the 
' predominant category of erroneous explanation in first grade, while arbitrary 
explanation predominated in second grade. Using the same procedure with mentally 
retarded children and adolescents, Antonak and Roberge (1978) found patterned 
explanations, structural defects, and verbal deficits the predominant errors 
made with MP, MT, and AC argument forms. Patterncu explanations were most 
prominent with ^D?, verbal deficita with AC, £jnd structural defects with MT. 
Finally, both studies fcun'^ a lack of correspondence between cf r^ectness of 
reasoning responses, and correctness of the verbal explrnatlon far the responses. 

The present study explored the patterns of verbal errors in explanation 
among Dutch children and adolescents. All prtjvious wprk cited was compiled 
on English-speaking children., If similar patterns of verbal explanations are 
found across ages, it would be convincing evidence of underlying processes not 
subject to language or cultural effects as Piaget (1953) has claimed. 

Methods 

Subjects were first, '.hlrd, fifth, and seventh graders (first year. 
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Lccondary school) described in the subjects section earlier. 

For this analysis, subjects' responses to the items on Form CA for 
which the four argument types appeared in the form shown in Table 7 were 
used. Since each item was repeated in four ways, every child responded to a . 
total of 16 Items. Further, to investigate the first hypothesis, the Kodroff- 
Roberge scoring system was used to classify responses. 

Results 

0 

The means and standard deviations, of correctness of judgments for each 
of the argument forms are shown in Table 7. It can be seen that most first 
graders \ould respond correctly to MP items, but that this high level of ' 
performance. apparently reduced in later years. It should also be noted that 
on DA and AC, the youngest children ijerformed substantially below the chance 

I 

level >?hich would suggest a pe^rfoimance average of 1.33 correct strictly by 
chance (there were three choices for ach of the four presentations of the 
arguments). The third and' fifth graders perforn.anco approximated this chance 
level for DA and AC, "while the oldest children reached a level' substantially 
above chance. . Further, the performance of the oldest subjects was more similar 
for the four arguments than was true f6r younger children. 

These patterns were further investigated with the Kodrof f-Roberge scoring 
system as modified for the present studies » The frequencies of categories of^ 
explanations tabulated by grade and argument form are shown in Table 8. As 
noted in earlier studies (Antonak & Roberge, 1978; Kbdroff & Robcrge, 1975), 
there was a widespread tendency to give faulty verbal explanations despite 
Judging the argijinent correctly, There was greater tendency toward verbal 
deficits (VD) in first graders than any other group. Arbitrary explau^tion <Afi) 
were the most prominent ki*nd of erroneous verbal explanation used by first , 
graders, and to lesser degrees, third and fifth graders. The seventh graders 
tended to give proportionately greater structural deficits (SD) . Hov;evcf, good 
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Table 7 

Means and standard deviatlonff of subjects' 
responses to four argument forms (AO is 
perfect score) 

Argumi(lli^ "form 
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• p 
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Table 8 

4 

Frequencies of Categories of Verbal Explanations for reasoning 
responses (Frequency of correct responses in patcntheses)^ 

b 

Verbal Explanation Category 



Grade 


Argument Form 


YD 


MD 


AE" 


SD 


SR 


PE 


GL 


1 

(n«12) 


MP 
MT 
AC 
M 


A(3) 
2(1) 
1(0) 
A(2) 


1(1) 
0(0) 
0(0) 
0(0) 


25(23) 
33(22) 
27(1) 
30(2) 


1(1) 
6(6) 
17(1) 
9(1) 


0(0) 
0(0) 
0(0) 
0(0) 


0(0) 
0(0) 
0(0) 
0(0) 


17(16) • 
7(7) 
3(2) 
5(2) 




XOkclX 


1 1 ff^\ 




lis (AM 










3 

(n = 12) 


MP 
MT 
AC 
DA 


2(2) 

1(1) 
0(0) 
0(0) 


3(0) 
0(0) 
0(0) 
0(0) 


29(12) 
29(13) 
17(3) 
13(5) 


3(2) 
5(2) 
13(1) 
12(2) 


0(0) 
0(0) 
0(0) 
0(0) 


oco) 

0(0) 
0(0) 
0(0) 


10(10) 

13(12) 
18(12) 
21(17) 




Total 


3(3) 


3(0) 


88(33) 


33(7) 


0(0) 


0(0) 


62(51) 


(n = 12) 


MP' 
MT 
AC 
DA 


0(0) 
0(0) 
0(0) 
0(0) 


0(0) 
0(0) 
0(0) 
0(0) 


20(12) 
18(7) 
19(4) 
17(5) 


4(4) 
10(6) 
15(0) 
17(5) 


0(0) 
2(2) 
1(0) 
2(0) 


1(1) 

0(0) 
0(0) 
• 0(0) 


23(19) 
18(18) 
13(10) 
12(6) 




Total 


0(0) 


0(0) 


74(28) 


r,(15) 


5(2) 


1(1) 


'66(53) 


7 

(n = 18) 


MP ^ 
MT 
AC 
DA 


0(0) 
0(0) 
0(0) 
. 0(0) 


0(0) 
0(0) 

/(I) 

/2(1) 


12(3) 
15(1) 
8(2) 
3(3) 


3(5) 
12(3) 
22(2) 
rK14) 


0(0) 
0(0) 
0(0) 
0(0) 


0(0) 

1(1) 

^ .1(0) 
1(0) 


51(50) 
44(44) 
40(37) 
36(32) 




Total 


0(0) 


/ 3(2) 


38(9) 


:'K24) 


0(0) 


3(1) 


171(163) 



The "other" category was omitted from the table because less than 
1% of the total responses fall into this category 

VD(Verbal d^flllits)^ MD(Memory Deficits), AE(arbitrary explanations), 
SD(Structural ciefloits), CR(Conditional reasoning), PE(Patterned 
Explanations), GL (Good logic). 

f 
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logic (CL) was the major category of response among the oldest group. 

Discussion 

Generally, the kind of erroneous verbal explanation children gave 
when describing their reasons for logical judgments appeared more related to 
tho age than to the form of the logical argument or syllogism. Older children 
in tfhe sample (about 13 years old) gave more good logic explanations, but 
when they gave erroneous explanations, their preference was for structural 
deficits (SD). l^hen corrected for nuniber pf students in the sample, the 
structural deficit kind of error did not seem to be reduced very much by ag*-, 
however. That is, according to the definition of structural deficits, the 
child seemed aware of the structure of conditional reasoning but did not describe 
conditional reasoning adequately In the explanation. This suggests that there 
may be. a tendency to explain reasoning with some deficits regardless of age, 
even when reasoning correctly. Further, it would seem that the Improved good 
logic explanations among the older children may be due to a reduced tendency 
to use explanations that can be characterized as verbal deficits and arbitrary 
explanations. 

Clearly MP was the easiest argument to deal with. However, It is interesting 
■ to note that the MP and MT items seemed more difficult for older childien. There , 
may be two concerns operating here. The first Is a deling effect. Since there 
were only four items presented in each form, the maximum score was reached by 
most children, and older groups could only do equally well or worse. But this 
does not explain the large variation between 3.67 and 2.25 found for the first 
and third graders, respectively. The second concern is directed moire toward 
explanation of this difference. Specifically, data in Table 8 reflect a 
reduction in Verbal deficits and arbitrary explanations between first and 
third grade. If verbal explanations arc taken OS reflecting the underlying 
th^.lght proccosGS, then it vouia seem that more mature thought would require more 
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considers clon in responding ♦ The matured thought process might make the 
easier questions more difficult, and the more difficult ones easier. Indeed, 
there seems to be a constant increase Ih good logic (GL) responses over the 
years relative to erroneous or faulty explanations* Further, there is a 
reduction in the ratio of rcorrect judgments of the truth of the arguments to 
erroneous explanations, supporting the contention that more complex thinking 
was going on* in the older subjects. 

Past research of this type was done only with English-speaking children 
in the United States (Antonak & Roberge, 1978; Kodroff & Robergc, 1975). Tills 
study was different from the earlier ones in three vays. First, it was done 
with Dutch-speaking children in Holland. Second, more argument forms were used; 
and third, the age range was greater in the present study. With these differences 
in lalmlj :lt can be noted that the present study did not find the prominence of 
verbal deficits and patterned explanation^! reported :Iu the earlier studies. 
Further, there was not a great degree of difference across arguments- in the kind 
of verbal explanation provided. Thus, neither age nor argument form provides a 
satisfactory e:cplanatlon for the differences in the present study and the others. 
Therefore, the native language of the children may be suspected of causing the 

V 

differences in verbal explanation. It would not be^^ft all surprising if the 
kind of verbal errors displayed in a task are dependentl\ upon the language one^ 
speaks. This finding should be explored further with children who speak other 
languages. ^ 

A final comment before leaving discussion of the data in this first study 
concerns the interpretation of children's verbal explanations. It is difficult 
to say how much of this depends upon the verbal fluency and skill of the cKild, 
and how much it depends upon his or her reasoning skill. To some extent, this 
question was addressed in the previous paracraph. However, the nature of the 
reasoning processes involved in cnowerin;; "fllc'i)l daL?" may be diff event frtmi 
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those Involvod In answering "V/uarom zeg je dat?" Some sufigestion that these 
processes are different can be found in the high number of correct judgments 
that were explained erroneously, especially with younger children. Again, 
this seems to be fertile area for research. . 
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Study 2 

Hypothesis: Class inclusion will be related to correct judgment of the 
truth of logical arguments containing material implication, 

I ntroduction 

The relationship between class inclusion and the logic of implication .h^s 
been inferred in the literature for some time (Brainerd, 1978; Ennis, 1975; 
Knlfong/ 1974) . Basically, this relationship suggests that children must be 
able to recognize superordinate and subordinate relationships before mature 
implication can be demonstrated. In the typical class inclusion (CI) problem . 
described by Piaget (1953) , a class of objects or elements A, and another are 
combined to forni a larger class B. Thus, 

A & « B 

1' 

The child is presented l\vt elements of A, A. , and B, and aslced if' there are 

more A or I^t For example, JB could symbolize a set of objects called all wooden 

beads, A would be "blue, wooden beads," and A"** would be "wooden beads that are 

not blue*" It can easily be seen that A can be added to A"^ to get JB. Although 

a child of five to seven years of age can typically say this relationship, it is 

not until later that the child becomes able to recognize that: 

A<B^ 
and B - A"^ » A • 

Thus, the child is described by Piaget (1952, 1953; Inheldcr & Piaget, 1958) as 
finding it difficult to think about part-whole relationships. Therefore, prior 
to b^ing able to deal with these relationships, it would be probable that after 
presenting a child with an array of objects, say beads as described above, the 
child would not be able to consistently say that the wooden beads outnumber the 
blue wooden \bcad3. This has been established in a number of empirical studies 
that have been reviewed elsewhere (e.g., Bralnerd, 1978, 1979; Dodwell, 1962; 
Judd & MervJ6, 1979; Kuhn, ^77; Wilkinson, 197G). Some researchers hava 
specifically found results Suggesting a compatibility of class inclusion s^kill 



and implication reasoning (Elklnd, Anaghostopoulou, Malone, 1970; Falmagne, 1975; 

Kuhn, 1977). Others have shovm that the cl^ss Inclusion problem is actually 

a complicated task involving a number of different skills and that it can be 

solved with ordering or transitive algorithms without actually recognizing all 

the features of mature implication (Trabasso, et. al. , 1978; Trabasso, Riley, 

& Wilson, 1975). ' * 

* 

As has been discussed by Ennis (1975) the logic of implication, and that 
of class inclusion imply the identical propositions: p q, p q, p^ q, not (p <q). 
On the basis of this and the research, therefore, one would expect the psychological 
processes Involved in responding to "are there more (A) or (B)? to be similar 
to responding to a question about a conditional argument such as: "If all (A)s 
are (B)'s, and this is an (A), then does it follow that it Is a (B)?" which 
contains the "A implies B" iraplicatloi. The present study explored the class ' 
inclusion aspects of such Implication reasoning. 

Method 

Subjects . The A5 subjects who participated in thfi study were Dutch children 
in kindergarten, second, fourth and sixth grades who had responded to Form PW. 
There was one more ^irl in the sample than there were boys. Average ages were: 
5.9 years (Kleuter) , 8 5 (second), 9.7 (fourth), and 12.3 (sixth). The upper 
two age levels from the PW sample was riot used because those children almost 
always responded correctly to the class inclusion question producing very little 
variance to study at the older ages. 

Materials . As described earlier, using Form PW, each of the. four argument 
types, MP, MT, DA, and AC, were presented four timep. The conditional arguments 
were not only read to each child, but were demonstrated using pictures, or toy 
animals or blocks. All oi the itemsvwcre about the blocks (i.e. "If all blocks 
arc wood, and this is a block (one Is shovm separate from the group) , then it is 
wood.") The child responcicd YES, NO, or MAYBE. In addition, each major premise ' 
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^ . A5 

was administered separately from the whole argument, (half of the time this 
was done before the full argument was given, and half the time afterwards), 
and the class Inclusion question; was asked* An example of the procedure is 
as follows: The child is first told '^AXl dogs are amlnals/' He or she would 
then be asked the class-inclusion question "Are there more dogs than animals?" 

Procedures » The subjects were given three practice items as discussed 
earlier in the section describing Form PW in detail. Following this the four 
part interview was adtnlnls tared, recorded, transcribed and scored using methods 
already discussed in this report. Then the number of correct responses to the 
four argument forms was correlated to the number of correct responses on the 
class Inclusion questions. 

Insults 

Tables 9 and 10 shmf the means, standard deviations and correlations between 
reasoning scores and class inclusion scores for each grade levels For the 
kindergarten and sixth graders, there were no statistically significant correla-^ 
tlons found. However, the moderate relationship between class inclusion score 
and MP score was significant (p<.05) at the fourth grade level, and the rather 
substantial correlations bet\^een class inclusion and DA, AC, and total scores . 
at the second grade level were significant (p^.OOl)./ Further, it can be seen 
in Table 9 that total reasoning score Improved at each successive age level. 
This systematic Improvement with age seemed to be due to consistent increases 
in scores on DA and AC, rather than the less consistent pattern found for MP 
and MT across age levels. 
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Means and standard deviations of scores on eac|r argument, 
total reasoning scores, and class Inclusion 



Grade 


Class 
Inclusion 


Argument 


Reasoning 
Total 


MP Mr DA AC 


X 

K 

SD 
(n « 10) 


' 18.80 
^ 18.97 


3.90 2.70 .20 .10 
1.60 2.06 .63 .32 


6.90 
2.08 


X 

2 

SD 
(n « 11) 


31.64 

• 

28.91 


5.00 3.36 .73 1.09 
1.00 1.29 * 1.27 1.70 


10.18 
4.14 


X 

4 

SD 

(n « 12) 
> 


26.92 
8.23 


4.83 4.92 1.08 1.75 
.94 1.16 1.31 1.35 


12.58 
3.26 


X 

6 

SD 
(n = 12) 


27.75 
6.66 


5.25 3.50 1.75 2.50 
.96 1.68 1.96 2.15 


13.00 
5.19 



If 
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TabJe 10 

Correlntlons of reasoninc scores on each argument and total 
reasoning score with class Inclusion (CI) scores for 
each grade level 





Group 


MP 


Correlations of reasoning scores with CI 
Mr DA AC Total 


kindergarten 


:i6 


.18 


.11 


.11 


-.01 


Second 


.39 


.44 


.89"* 


.83** 


.85** 


Fourth 


.60* 


.05 


-.29 


-.30 


-.09 


Sixth 


.55 


.36 


.25 


.12 


.36 



* p/. .05 
** p<. .001 
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Discussion 



\ 



In regard to the original hypothesis that responses to the dLass Incluuion 

\ 

question should correlate with responses to arguments containing cort^ltlonal 

\ 

Implication, the results seem mixed at first glance. On the one hand,\class 

\ 

Inclusion score seemed significantly related to reasoning in only one ins\^nce 
(MP) In the fourth grade group, and three In the second grade group (DA, Ac\and 

... • 

total). On the other hand, a closer look at the descriptive statistics In 
Table 9 suggests that the results may reflect a greater relationship between 
the CI response and reasoning scores than the correlations along suggest. -For 
example, the CI responses in Kindergarten appeared to be a little better than 
chance (on the basis of two choi?:es,, and 32 items). Hie large standard deviation 
of CI in the kindergarten sample further supports the supposition that many of 
those children responded randomly. 

Looking at the oldest group, another kind of problem appeared with regard to 
interpreting the correlations. Specifically, the relatively high scores and 
small standard deviations for CI in fourth and sijth grades suggested attenuation 
bf the CI scores at those levels. This would have the effect of depressing the 
correlation coefficients. Thu^, since students tend to do uelJL on CI above 
4th grade, ^he relationship between CI and reasoning cannot be explored at 
those levels using the instrumentation of the. present study. 

Considering the statistical characteristics of the data, it does seem that 
correctness of response to the class inclusion question is related to correct- 
ness of reasoning. This conclusion is made based on the omission of data from 
grade six and kindergarten due to attenuation and random responding, respectively, 
Iherefore, the data which seem most useful to this hypothesis are those of the 
middle two grades at which four out of ten correlations were positive and 
statistically significant as proposed In the hypothesis. 
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■ _ _ : ^ , 49 

Ttte present research suggests some recommendations for studying the 

relationship between Implication reasoning and class inclusion. First, the 

ability to handle class inclusion questions seems to be emerging at about 

eight years of age. This is not very different from what was sut,gested by 

other researchers (e.g., Dodwell, 1961, 1962; Inhelder & Piaget, .1958; Piaget, 

1953). Although it has been shown that younger children can be taught to 

answer class inclusion questions correctly (e«g., Trabasso, et. al., 1978), 

their level of understanding of , class Inclusion has not been dem9nstrated as 

equal to older children who annu'er CI questlbns correctly. Therefore^ children 

of five yeal? old or kindergarten age are probably too young for a meaningful 
♦ 

study of class inclusion. Second, the prcr.unt study did not Investigate the 
range of tasks usually considered to represent class Inclusion (Brainerd, 1979; 
luhaldcr & Piaget, 1958; Klahr & Wallace, 1972; Trabasso, et. al, 1978). A 
future sLurly of class inclusion and implication reasoning should use a greater 
range of class Inclusion tasks. Not only would such a range of task^ provide 
a more complete assessment of class inclusion, but also might provide enough 

i 

range of response to reduce the problem of attenuation of the CI variable that 
was found in the present study • 

In conclusion, the present study provided evidence that class inclusion 
is related to conditional .impllca>tlon reasoning. ^ From the data it appeared that 
the youngest children (about five years of age) were responding to the CI question 
randomly, while the oldest ones (about 12 years old) tended to respond to it 
correctly. Further, the CI performance seemed to be somewhat in transition and 
related to reasoning at the second and fourth grade level. Finally,. Improvement 
in total reasoning seemed to be most related to imporvcment in reasoning with 
invalid arguments requiring the MAYBE response (A and AC) , a finding which 
corresponds to earlitar research with English-speaking subjects (e.g., Hadar, 1975, 
Robnrge, 1970) . 
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Study 3-. 

Hypothesis: There will be an inverse relationship between 
response time and correctness of reasoning which reduces 
as children become adolescisnts. 

Introduction 

A considerable body of knowledge has been developed regarding the difficulty 
of the four logical arguments MP, MT, DA, and. AC for children and adults. Roberge 
(1970) reported that the invalid principles of affirmation, of the consequent (AC) 
and denial of thii^antecedent (DA) were more difficult than the valid modus ponens 
(MP) and modus tollens (m) . Research by Hadar (1975) with elementary school 
children and O'Brien (1973) with high school subjects, have reported the following 
order of difficulty e * . 

MP/MT<DA< AC. . • . ' 

In other research. Roberge (1970), Roberge ^d Mason (1978) and Mason, Bramble 
and Mast (1975) found the following slightly different ors^eruwlth small differences 
between difficulty of DA and AC: 

MP<:m<Ac<DA 

uidng*- fourth through tenth graders as subjects. 

Roberge (1971) added a fifth principle^ transivity "(TR) to his study of 

difficulty of conditional reasoning in college students, (the transivlty argument 

\ ' 

form is: PJ Q, Qi» R, P3 R) and found 'tfte following unique pattern of difficulties 
among the adult subjects: 

MP< TR<DA<AC <m* 

Although there was no explanation for the unusual difficulty of the MT form in 

this study, Roberge noted that many subjects tended to respond that the argument ^ 

I • 

was neither valid nor invalid* Excepting this one study, according to most 
research, the easiest argument to recognize as true seems to be MP, followed 
clofiely by MT. i^fflrntation of the consequent and denlcvi of the antecedent seem • 
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about equally difficult, but more difficult than the other two. 

'?he present research was undertaken to explore the use of response time ' 

as a measure of response difficulty on judging logical arguments. Response 

time would seem to be an appropriate measure of task difficulty from psycho* ' ; 

logical information processing. The rationale for this point of view would be 

that more difficult problems 'require more steps for locating solutions. If a 

» 

problem Is easy "to a subject; the solution should require fewer steps (Homa, 
1973; Newell & Simon, 1972; Wohlwill, 1962). Response time, and a closely 
related variable^ reaction tijme» are among thf^ earliest va^iiables studied by. 
psychologists and those interested in mental procesceii (e.g.» Dotiders^ 1869 
cited in W.' G. Koster, 1969)* Although there hac been considerable research 
done on the time one takes to respond to different kinds of tasks» relatively 

little has bccin directed tovjard JudKins of logical arguments. Al^ 
though Revlin and Leirer (1978) have argued that increased tim^ will allow 'more 
task scanning, ami Huttenlochet (1968) has given evidence of difficulty of\ 
judging a premise in a transitive ordering task and time required in responding, 
l-^.ttle has been done regarding the relationship between argument difficulty, and 
response time. The present study explored this with respect to reasoning with 
condibtdnal syllogisms whose relative difficulty had been established in 
research discussed previously. Specifically, the stiudy was conducted to determine 
whether the response latency for MP, >n?, DA, and AC argument forms would match 
the order of difficulty reported in earlier studies- 

> 

Methods 

Subjects . Fifty- jPour Dutch students' responses to the Form CA were used 
in the present study. The students were from the first, third> and ^Ifth grades 
and first year of secondary school. Their characteristics were described in 
an earlier seccion of this paper. 
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Materials . The childircn were administered the Form CA interview in th^ 
manner discussed earlier. Since the present study was only concerned with the 
four arguments in their most common form, only the 16 Items that were in the 

6 . , . ' , 

form shown in Table 7 were used in the .present study. 

Procedures . Data were collected as described 'earlier. Students were 

given one point for each correct response, and scores for each argument were 

* ■ . 

summed. • , . « ' 

Results \ . ' 

Table 11 shows the means of time arid reasoning score (average total mmiber 

.of correct items). As canj^e seen from tlie table, the average scores suggest 
patterns of difficulty described earlier in other studies. However, the time 
stores did not follow such a pattern, CoiTxelations between time and score at 
each grade level for the .for argument forms produced only three statistically ' 
significant correlations ^imong the total of sixteen possible. The MT form ^ 
produced a signif icantt'correlation (P<.05) for third grade (-.50), and fifth 
grade (-.63;. MT had a signlfica*it correlation at the secondary school level 
(-.43) (p<.05)." In shor.t, for these significant correlations the shorter the 

^average response time, the higher^ the reasoning score as expected. However, 
the relation^ij)>k>es not appear to be substantl.al. Further, the total score 
obtained by. summing performance across arguments \/as not significantly correlated 

♦ 

to total 4ime at any grade level. 

C onclusions ' ,^ . , ' 

There seemed to be no systematic significant' correlatioris between reasoning 
scores and. response time. However, this lack of 'product-moment correlation should 
not be taken to mean lac^ of some kind of consistent relaMonship. Figure 1 
Dhows the graphs of responses to the four argument? forms with the corresponding, 
times across the four age groups of the present study. There appears to be a 
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Ijab-le 1 

Scores and response times onl four conditional/ argument forms 



Grade 



MP 



3core Time 



a 



Argument Forms 
MT. 

Score Time 



DA AC 
Score Time Score 



Time 



1 SD 
(n - 12) 



3«66 



9.60 



.65 A. 18 



2.66 12.49 .58 12.50 .33 9.38 

1.50 A. 06 , 1.2A 3.75 1.15 3.19 



X 

3 SD 
<n « 12) 



first _ 
year X 
secondary 

SD 



2.25 12.08 



1.42 



8.33 



2.33 
1.44 



13.76 
7.91 



2.00 13.89 



1.70 8.10 



X 3.08 12.02 

5 SD 1.31 8.68 

(n « 12) 



2.75 12.09 
1,42 4.92 



1.33 12.93 



1.78 8.66 



1.33 9.68 



1.56 3.12 



1.67 9.16 



1.47 3.11 



\ 



(n«= 18) 



3.22 
1.11 



9.69 
4.71 



a 



Time is indicated in seconds. 



2.72 12.76 
1.45 4.92 



2.33 13.02 2.77 9.16 

1.53 6.79 1.52 3.57 



/ 



ERIC 



55 



54 



sponsc 
m in 
!Conds 



15 



10 



'ierage A 
masoning 
tore 2 




response 15 
time in 
seconds 10 




average 4 
reasoning 
score 2 



Secondary 



■) F 



3 

grade 



Secondary 



;sponse 
.me in 
iconds 



15 



10 



feragc 4 
masoning 
!ore 2 



m 




Secondary 



15- 



10- 




Secondary 



Figiure 1. Response times and reasoning scores for the four arguments 



plotted against age. 



ERIC 



56 



55 

fairly consistent tendency for the younger and older groups to respond relatively 
Quickly ♦ On two arguments, MP and the more rapid response times are associated 
with higher scores, and the slower lesponse times with lower scores • However, 
for DA, the elementary grade pattern seems to suggest that when children, took 
more time, they tended to give more correct answers. But the secondary students 
performed best on these items although they had short response times. 

All this seems to suggest that there are relationships between arguments 
and response times but that they are complex. Therefore, referring to the original 
hypothesis, response time seems to be inadequate as an indicator of difficulty. 
Further, results of the present analysis suggest that investigation of the 
strategies or processes underlying the correct responses might explain the 
complex relationships observed bctv/ieon response time and reasoning scores. 
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Study A 

Hypothesis: The class meaning of a logical argument as reflected by 
subjects' explanations of their reasoning will_c£rr£spond to_tho 
four components of material implication £*5l>^ (£*il) • 

Introduction 

It has been recognized that behavior that is observed may be the result 
of different internal processes, and that describing observable behavior docs 
not necessarily describe the thoughts that occured with the behavior (DeCorte, 
1977) • Numerous attempts have been made to explore the thoughts behind the 
logical behavior of children and adults. Most attention has been focused on 
processes underlying erroneous reasoning. For example, Helaabeck (1975) 
suggested that a cause of faulty reasoning vas a tendency to overlook alter*- 
natives in choosing or judging a concluG^.on, Yet, Cerapo and Proyitera (1971). 
argued that faulty understanding uf piC:mif;os crni produce erroneous reasoning. 

Researchers have questioned the existence of PJnget's 16 binary operations 
in mature reasoning. For example, the 16 binary 'operations have not been easy 
to demonstrate (Bynam, Thomas, & VJeitz, 1972; Robcrge & Flexer, 1979(a); Woitz, 
Bynam, & Thomas', 1973). Kuhn (1977) has reported evidence supporting the four 
components of implication that are available to the formal operations thinkc^ 
from the 16 binary propositions (p • q, p*q, p^q, N(p# q). However, the last 
component > the denial of non-implication, could not be supported by van Duyne 
(197A) . Further, it has been suggested that transductlvo reasoning, in which 
the Implication connection is understood as "and" (i.e. £»jl rather than il) , 
is used by young children to provide correct judgments in some forms of pro- 
positional logic (Knifong, 197A). As Kuhn (1977) suggested, a child using 
transductive reasoning would not understand conditional or causal relationships 
between elements of propositions. . 

•The objections to Piaget's logic of material Implication raised by Ennis 
(1975) and others war discussed earlier in this report. Ennis' criticisms deal 
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mf re with the loRic of PiaRot than with the thinking processes underlyinp, 
reasoning behavior. For exan^ple, Ennis objected to Piagct's unclear utic of 
the "v*' symbol to variously mean ••and," "or," "and/or," the possibility under 
Plaget's systiem of the existence of something both (p), and (not p), However, 
such inconsistencies may be possible in thought even if they are not possible 
in reality. 

Smedslund (1977) has taken the position that logical operations do not 
exist as Piaget has suggested. He based this assertion on the observations 
that children behave differently when faced with a change in the content of a 
task having the same logical structure, that people do not seein to ordinarily ^ 
behave abstractly, and that the direct evidence for logical is scant. Smedslund 
argued that the researv^hcr in psychology usually pursues a person's understanding, 
but in the Piaget system, one assumes understanding and pursues the logic fostered 
by the understanding. According to Smedslund, there is a circt^larity between 
understanding and logical performance that is difficult to untangle. Staudenmayer 
(1975) suggested that interpretation of premises in logical arguments is an 
inductive process, and that when individuals do not seem to reason according 
to formal logic, they may be behaving logically according to their understanding 
of the premises. Further, Halpern (1965) discussed a perceptual dependence in 
logical thinking that is more prominent in children 5-7 years old. During 
this period, according to Halpern, a perceptual dependence could hinder the 
child fromi correctly judging a logical argument by focusing understanding of 
the premises in terms of irrelevant (or loss than salient) observable traits 
of the elements in the premises\ ^ 

Thus, while researchers have generally recognized the role of understanding 
of the premises in logical reasoning, there has not been much closure on how 
understanding is determined,' or wliat influences it. The present study wa« 
designed to explore a child's understanding of the premises in .logical argumonl^ 



ERIC 



58 

through their explanations of their judgments of the validity of their 

arguments. 

Method 

Subjects: Thr, students in the first, third, and fifth grades, and the first 
year of secondary school that were described in an earlier section of this 
report served as subjects in the present study. ^ 
Materials ; Form CA responds to the 16 items for which the conclusion vjas not 
negated were scored by the three Dutch graduate students in developmental 
psychology v?ho had collected the data. 

Procedure ; Scoring procedures and criteria for the C-L scoring system that 
were described earlier were used in the present study. After the scoring was 
completed, scores were transferred to computer cards for analysis. 

Rosults . / 

Tables 12 and 13 show the frequency and proportions of the categories of 
class and logical scoring systems for each grade. It Is immediately apparent 
that the children's explanations covered a variety of both class and prepositional 
categories. However, the^jj^ interpretation seemed to occur somewhat more 
often than most other class categories. Further, the most frequently used 
class relationships category had P<Q paired witl^ ^j?^ This pair was represented 
between 16 and 23 percent of the time until 5th grade. In the first year 
secondary school students, it appeared much more frequently than that (A2%) . 
This category would seem to represent the most complete understanding of the 
class relationships underlying material implication, and it is noteworthy 
that the secondary school children used this category about twice as frequently 
as the younger children. 

A similarly dispersed pattern of categories of propositions was found by 
classifying explanations using ..jc logical system. As can be seen in Tnble 13, 
P#Q was generally used in about 10 to 15 percent at all age levels, and P«Q, 
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Tabic 12 



Response categories for all arguments combined 
for class scoring system (proportions In parenthesis)' 



Response 
Category b 





Grade 






(n=18) 


(n»12) 


(n* 


12) 


(n»12) 


First year 


One 


Three 


Five 


secondary 


30 (.16) 


18 


(.09) 


5 


(.03) 


4 (.01) 


1 (.01) 


3 


(.02) 


3 


(.02) 


1 (.00) 


2 (.01) 


2 


(.01) 


0 




0 


* 

0 


1 


(.01) 


1 


(.01) 


1 (.00) . 


7 (.04) 


3 


(.02) 


3 


(.02) 


0 


20 (.10) 


19 


(.10) 


15 


(.08) 


27 (.09) 


31 (.16) 


45 


(.23) 


39 


(.20) 


36 (.13) 


16 (.08) 


1 


(.01) 


20 


( . 10) 


21 (.07) 


0 


2 


(.01) 


0 


♦ 


2 (.00) 


32 (.17) 


18 


(.09) 


24 


(.13) 


24 (.08) 


31 ( . 16) 


36 


(.19) 


44 


(.23) 


120 (.42) 


7 (.04) 


23 


(.12) 


22 


( . 11) 


15 (.05) 


2 (.01) 


. 5 


(.03) 


4 


(.02) 


13 (.05) 


1 (.01) 


6 


(.03) 


3 


( .02) 


12 (.04) 


0 


1 


(.01) 


0 




1 (.00) 


0 


0 




3 


(.02) 


0 


0 


1 


(.01) 


1 


(.01) 


0 


) 2 (.01) 


0 




2 




0 


3 (.02) 


1 


(.01) 


0 




2 (.00) 


0 


1 


(.01) 


0 




1 (.00) 


3 (.02) 


0 




0 




0 


3 (.02) 


2 


(.01) 


0 


y 


5 (.02) 


1 (.01) 


3 


(.02) 


2 


(.01) 


3 (.01) 


0 


1 


(.01) 


1 


(.01) 


0 


• 

192 


192 




192 




288 




^ Total 192 



a ' 

Proportions i;ounded to nearest one-hunHrodth 

^ Categories 9-23 are combinations of the first eight. 
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Table 13 

Proposltional locic categories of explanations 



for rcasonlnr . on Mf. >fr, AC. DA * 



Class logic 
category 



Total 



a 



Proportions rounded to 
Catep.orlea 9-27 nre 



Grade 



One 
(n=12) 



Throe 
(n=12) 



Five 
(n«12) 



192 



192 



192 



nearest onevhundredth, 
^ Cqtecories 9-27 are combinations of the first eight, 
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Eerste 
(n»18) 





No Response 


2A 


- — r- 

( . 13) ■ \ 


16 


(.08) 


2 


(.01) 


7 (.02) 




P 


5 (.03) \ 


0 




0 


• 


1 (.00) 


2, 


Q 


2 


(.01) 


1 


(.01) 


1 


(.01) 


. 0 • 


3. 


P 


1 


(.01) \ 


1 


(.01) 


1 


(.01) 


1 (.00) 


4. 


Q 


5 


(.03) 


9 


(.05) 


2 


(.01) 


0 


5, 


p. Q 


20 


(.10) 


28 


(.15) 


20 


(.10) 


34 (.12) 


6. 


P'Q 


2A 


(.13) 


31 


(.16) 


AO 


(.21) 


44 (.15) 


J, 


p.Q 


22 


(.11) 


\ 2 


(.01) 


25 


(.13) 


22 (.08) 


8, 


(P'Q) 


2 


(.01) 


1 


(.01) 


0 




1 (.00) 


9t 


N(P.Q) 


0 




■\ 1 


(.01) 


0 




0 


lu, 


P«Q» P'Q 


35 


(.18) 


\ 16 


(.08) 


26 


(.14) 


31 (.11) 


n, 


P»Q, P«Q 


26 


(.1^) 




(.22) 


36 


(.19) 


106 (.37) 


12, 


P'Q, (p.Q) 


7 


(.04) 


21 


(.11) 


12 


(.06) 


12 (.04) 


13. 


P«Q,A/(p.Q) 


9 


(.05) 


1 


(.01) 


7 


(.04) 


6 (.02) 


M. 


P.Q, p.Q, p.Q 


0 




3 


(.02) 


3 


(02) 


11 (.04) 


15. 


p.Q, p.Q, P.Q,'>'(P.Q) 


0 




4 


(.02) 


0 




3 (.01) 


16. 


p.Q, p.Q, p.Q, (p.Q) 


0 




:5 


(.03) 


8 (.04)' 


1 (.00) 


17. 


P.Q, p.Q, (p.Q) 


0 




1 

0 




6 


(.03) 


1 (.00) 


Id, 


P'Q, P-Q, (P'Q) ' 


2 


(.01) 


2 


(.01) 


0 




0 


19. 


P, P 


3 


(.02) 


0 




0 




1 (.00) 


20. 


P.Q, P-Q, ^ (p.Q) 


3 


(.02) 


0' 




0 




4 (.01) 


21, 


P.Q, P.Q,'N/(P-Q) 


' 1 


(.01) 


0 




0 




0 


22. 


P'Q, P-Q 


0 




6 


(.03) 


2 


(.01) 


1 (.00) 


23. 


p.Q, (p.Q) 


0 




1 


(.01) 


0 




0 


24. 


p.Q, p.Q, p.Q. (p.Q) 


0 




1 


(.01) 


0 




0 


25. 


Q, Q 


1 


(.01) 


0 




0 




0 


26. 


P'Q, P'Q 


0 




0 




1 


(.01) 


0 


27. 


p.Q, P.Q,'^'(P.Q) 


0 




0 


1 


0 




1 (.00) 



288 



.p»Q was gcncrnlly used in 8 to 18 percent at all age levels. The same was 
true of Q, at the first, third, and fifth grade levels, but for this 

category at the secondary level, the proport-^on of responses nearly doubled. 

The variation in C-L response categories across the four argument forjps 
is shown in Tables 14 and 15. With the class scoring system, between a third 



and a quarter used the roost complete kind of response (P^Q,^ fj). There did 

tit ^M,*^ 

not seem to be very much difference in the kinds of categories of explanation 
given for responses to the four argument forms with either the class or the 
logical scorinr* About a third to. a quarter provided the most frequently given 
category of response on the logical proposition scoring form, P • Q, P ♦ Q. . 
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Table U 
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Rcspon.s(» categories on the Clnss scoring system for 
onch nrgument (proportions In parentheses) 



Argument Form 



C ntegory 



I- 



No Response 
P= Q 
P>Q 
P<Q 

m 

P.Q, 

P>Q.® 

P = Q, Q.O)({£ 
P>Q.(SS> 
P- Q,©® 0> 

p»Q.cQ)<£0 

P>Q,^I2) 
P<Q 

Total 



MP 


MT 


AC 


DA 




TOTAL 


lA ( r\f.\ 


18 


( .08) 




9 


(•04) 


57 


(.07) 




1 


(.00) 


i\ 
u 


A 


(•02) 


8 


t .01) 




0 




9 t (\'\\ 


0 




A 


( 00) 


A ^ 
v 


0 






2 


(.01) 


3 
•J 






2 


(.01) 


A (.02) 


2 


(.01) 
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Proportions rounded to nearest hundredth. 
Categories 9-23 are combinations of the first eight. 
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I 

RcspoiiBe Categories on the Proponltional 
Logic scoring system for each argument (propositions in parentheses)^ 
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Propositions rounded to nearest hundredth. 

CaloRoripR 13 - 27 are combinations of the .first eight* 
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Discussion 

The results were interpreted as suggesting that the hypothesis received 
only liinite4 support from the data. Specifically^ it appeared that there was 
some growth, as children become older » toward more complete recognition of the 
combinatorial subordinate and superordinate class relationships underlying 
the elements} of propositions in material implication. However, there appeared 

i • ■ ■ * ' ' 

to be great variation in the kind of relationship th|it could be ^Inferred from 
subjects* 'explanations* even with the oldest children in the sample. 

Further., with regard to the original hypothesis, the four components of 
material imp3.ication [j[£*Jlf £*Jlf £*£»^ generally observable 

in the subjects' explanations. This suggested that the logical propositions 
underlying children's responses/ to logical tasks may not be complete in the 
form«il logical sense, even with children who are supposedly operating at a 
formv'il level (13 years old). 

/ One should approach these data with a number of cautions in mind. First, 
as Brlanerd (1973) pointed out, explanations may nor. be good reflections of 

reasoning behind judgments. There are a variety of tasks to perform in formu- 

/ 

lating and providing ar^ explanation that are greatly simplified \^en only a 
one word judgment resp/onse is required. Thus, the intervening processes could 
inhibit accurate representation of understanding in a verbal explanation. 

A second area of caution concerns the C-L scoring form. While the inter- ' 
rater reliability was adequate, only large differc^nces should be interpreted.^ 
For that reason, only the categories getting proportions of ^10 or more were 
discussed in thie report. When response rate was at a lower uevel, the stability 
of the category might be questionable. 

.With these cautions in mind, the findings were rather consistent with the 
literature. For example, logical judgment tasks have been suggested as separate 
from understanding of the fogic involved (Smodslund, 1970). The relatively 
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higher rate of correct judgmonts of the truth cLntus of the four arputncnts 

7 

reported earlier CTable 7) susgosts that, such a task is different from 
giving explanations for those judgments on the basis of the inconsistency 
of categories of response seen in the C-L scoring. Further, previous research 
quest,ioning the existence of- the 16 binary operations in logical thinking 
(i.e. Bynam, et al., 1973) ,wao supported by the present data.- 

Researcher? have suggested a variety of explanations for the difference between 
performance on 3-ogical tasks and understanding of that performance. For example, 
Begi; and Denny (1969), Chapman and Chapman (1959), and ottjers have pr^oposed an 
"atmosphere" effect in which quantifiers, negation, and ot!her characteristics 
of the premlfics of an argument affect the conclusion* Johnson-Laird (1975) 
stressed" the role of prior beliefs. Northrup (1977) emphasized the nature of 
the task, and ji;o on. • « *^ ' • . 

IMs study raises many queotions' that will be addressed in subsequent 
analyses of these data. For example, the relationship of class to logical 
category, and the relationship of cat'tgory of explanation to correctness of 
response will be explored. Further, the effects of part-whole presentation 
(Form PW) and verbal versus visual presentation of the premise material seem 
to offer promising avenues fpr further analysis. 



' I 



i 

i 
t 

67 



66 



IV' . • ' > 

V 

Conclusions \ • 

4 

The four studies that have been comploL^d so tar repies^^nt only a small 
part of the possible analyses created by the data. ' However, they do suggest 

,e 

some insight into the complex reasoning processes of children and adolescents. 

' ' '' 

For example > the data suggested that verbal deficits in explanations were only 
a major problem for first graders. Children in the older groups gave progrcs- 
sively less arbitrary explaiiatic and more good logic explanations. These 
findings suggested that the moans of' explaining seemed to mature \rlX\\ age. 
There were not significant differences in this pattern at, different ages. 

Further, with regard to explanations, the logical prerftises expected. to . 
become mox^e prominent in older r.tudents (according to Piaget's (1953) logical 
components of implication) did not nurfacr*. Rather > explanations se<?med to 
reflect a wide variety of ' uudcvstandiiigs of the prci.dtjec at all agos. A similar 
pattern v/aS ^ounJ for the class scoring' suggesting that clt^ss relationships In 
logical premises containing implication may not be routinely inferred. Aga|.n, 
the argument form had little effect on the patterns of explanations. This /is 
particulary note\i^orthy when compared to the increased rate of corjpect responding 
with age, and the differential rate, of correct responses to ^ch argument form. 
One obvious conclusion migHt be that the judgment of the truth of a syllogism 
represents a different, anS^perhaps easier task than the explanation of that 
judgment. 

Tha data* suggested that class inclusion was relate'd to the ability to judge 
the truth of logical arguments containing implication. This is compatible with 
wh It V7oyld be*expected, and har> often been assumed. 

Response time seemed to be related to response correctness in an unprcdicted 
v;ay. That is, when correct responding wan highest, response time was shortens t. 
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This occurcd.cvcn when youniier children were more correct than older children 
on the modus poncns. This suggests that the younger children were responding 
with a rather simple algorithm which led them to respond correctly to IIT. Fur- • 
Cher, the simplicity of the algorithm would lead to shorter response times. The 
algorithm did not work as well with the other argument forms, however, ^^ean- 
while, as the children were older, they responded on the basis of a more complex 

algorithm, and v;ere only familiar enough with in at the oldest age level to 

\ 

have Increased number of correct responses and shorter response times. This 
line of reasoning will be explored in subsequent analyses of the data. 

The pattern of correct responses was similar with the Dutch students who 
participated .in Lho preroni: ntudy to previous results mostly with Engliiih-speaking 
groups. This cugp^^sts thai: the unclcrlyibg structure for loaical reasoning 
develops indepv^.dcnt of lc*^^uago and culture, ns svggested by Plage t. iIo\7ever, 
there might: be cone subtle dif fercuc^'^.r. to be found in the logic employed by 
English and Dutch r^peaking phildren. This wi' -m. pursued in subsequent studies. 

The present studies provided for the development and standardization of 
two interviews designed to pursue childrens' understanding of logical arguments 
and premises. Hopefully, thepe interviews will help fill the void recognized 
by other researchers in the field (e.g., Evans, 1972). 

finally, analysis of the data collected in Nijmeger in 1979 is continuing. 
Some future analyses will explore the effects of negation on explanation, the 
effects of separation variables on logical explanation and judgment, the relation- 
ship of^ materials in the premises to logical explanation, and part vs. whole 
presentation on re.'' oning. 
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2 

Ik ca jo eun puar Ul/ij^on aeatien, isoala bijvoorbeeldj 
JJIT ,1;^ MAhlA 

en dan zal ik ieta over haar vertellen zoals: ze heeft een 
biauwe jurk aan, 

pok'/al Ik Je er dire eon p^ani" vratjen over citollc^... CS.i iioct ' 
or flchter zien to komen of het Irlopt' v.tI, ik s:e£i, 
Jo kunt op dric •rnanlercn r.ntvoojH' f,cvc:n; 

2) i-rf^Ti. DAT )jj'?hK.ijjt.i.' .nvj! ir:^' i.'ii-vj.' urijy}::):]^ 

3) MXrfsciiiT'i-i. p/.T jy-jTiJiyor'j) .1.);.'.!? do;;.s rj.j-.iscjjj'.Bi.i 

• y/KL KLOPT, )jAo: ik jr. laEtf Gr.NOJDG Vr-RT.l-LD 

HEB OJ'i WW Zy.yj'M i'}', V.'J'Tr.i!. ^ ■ 
BJ. jvoorl)C:u.ld I nte3. jc vooi- d.it j.k zei.?; 

MARIA IS (lihVlWD'J' ZlCi\) KAAoT Div KKOOr. 
. DAN (bhVlAJ^T ZlCn) jJi, KIsOOP NAAoT MARIA. 
Is net ,iui.8t als i»c dan z»itJ d.-n. de knoop naast Maria' is? 
(wacnt, op hut, aniv/o.uru van net kind, ze£ aaarna: ) 

■ Ja iti t'.<i% j-^oede antv/ooi'd . " • • ' 

Laten v/e een ander voorbeela pro bore n; 

Lhw KOj:. I:> fiKOTLR DAN k^t^A KaT. 
DAN 16 bLN KAT OKOThH 1)AW JihN KOE* 
Is het juist als ik dat zeg? 

(Wacht op hot antv/oord van net kind, zeg daarna: ) 

Nee is het goede antwoord omdat een koe' niet 
grotcr en kleiner kan zijn dan een kat* 

Laten v;e no^ een ander voorbeeld proberon: 
KAAJ 16 V0):i)6kJi. 
JDAN lb VOEDb£L KAAS . 



Klopt hut als ik ze^f, dat voeUael kaas is? 

(viacht op net antwoord van net kind, zeg daarna:) 

Denk er aan dat je alleen JA, NEE of MISSCHIEN 

kunt'zcggen. 

(v/apht op het aatv/oord van hot kind, zc{^ da^^xm- O 

r 

Het antv.'oord Mcr ic rrCSSaurT." owcIdJ; vocdrsc.T 
kaac ko.n aijn ox con amTr;:-? flinfi ('at te.!^ 
oton j^onlf? broof\ of. vlcof ; >>2C^-'-'^-JP 

Zegt hci kind nao, Icfej het darj daaraa no^ cone uit en ccluniik 
d aa-j.-b j ;j .*-p la a !■ j e n 
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(de proefleider zet de hond in do bak). 



\ 



3 . 

1. Bo picrieidu,. a„t buk A vour het kind iwur iiest: 

^"■'^J^.^'^ Prnf^JAUil . ( tuivijl dc wuordcn uitgeoproken wordon. 

^'ijs* <1« |)roefleiaer op de hond en dan op 
^« reot van de dieren), 
M< DIT. IS Em HOND. (de, proefleider laat het beeldje van de hond 

''i®* buiten het gesichtsveld waa get^ouden), 

DAN MOirP lie DEZljJ BIJ DE DIERBM 
WPEN 

i« KLOPT DAT? 

Al8 het kind geen Btandaard antwooni geeft. ( ja, nee, misschien) ze^t proefleider: 

DEWK ERAAN DAT JE ALLEEN JA KUNT ZBQOEy. DAT BETEKEIJT DAT HET MOBT KLOPI?EW. 
. MEE, DAT ^TBKUiT DAT HET NIET KAN KLOl-PEN. OP- 

msSCHIEN, DAT BETEKENT DAT HOT S0M3 KAN KLOPPEN, MAAR MT IK JE NIDT GEI^OEa 
VEHTELD HEB OM ER ZEKER VAN TE ZIJN, 

Wanneer het kind een standaard antwoord geeft, ,ra^t de proefleider: 

B, WAAROM ZEG JE^DAT? ' 
Na het antwoord van het ktn,!. ^^t de pivtil,. ■^iciv<ioor: 

C. VERl'EL ME WAT flET BETEKcINT ALli lK.mv,2i JE ZLG, 
ALLE MONJjbJ/ ZIJN DiEhEN. 

Witnneer het kind cxntwoord gcd t, vraa<,'t ,iu pt .ol le uicr: 

ZIJN ER MEER HONDEN OP DfEREN? ku. pr .el lc .der: WAAROM? 

, Wanneer het kind untwoord igeet t , j^aat ae ppuo»'.o idc- r dc^or: VERTEL ME NIJ WAT 
DIT BETEKENT: 

. E, DIT IS EEN HOND ( De proefleider wijut op de hond in de bak) 

DAN MOET IK DEZE BIJ'DE DIEREN ZLTTEIU / ' • 



I 
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-POMCA- 



\ 



If ^ * 

i ij ««tft da«, BLOKKKN VAN HOUT ZIJM (Pl. U«t Op bUd g<»plwit9te blokk*!: 

^ DIT IS NICT VAN MOUT (Jl^Lt /row Icubus .ion) . ' ' *^ 



DAN Ifii HliTr EEN BLlK 
•JCLOPT- DAT? 



(Pl* pliititet eroono I'nibua buitem >1« 



DBfi ERAAN, JB KUNT ALLBCU l-IAAR JA ZEOOEN, -DAT BBTFm'T DAT HJST rOl^J KWP;^.' "* 
OV NEE, HAT BETEKENT DAT HET MIET KAN KLOPPEK, OP IJiaSCHIElI, MT m'SKKKT DAT ' 
IK JE NffiP OENOEtJ VERTELD HBD OM ER ZEKER VAN TB ZlJH. ' J 

< ••• . . . 

Waiuie«r het kind een ctandaard-antwoord hoeft fioijovcu, vv^t da proofloidor; ' 

B.»v .WAAROM ZEQ JE DAT? 

♦ 

OBBerkin^ 2: Het kind ooof in Btoat geatold kiumen worden de proofloidoy 
duidelijk aan to toncn dat hij/zij de voliedige betckenia van de implicivtie in 
de pruciiuafn en Ue cunoluBio heuoJueven Wf^eTt zoala hjj/zij die begrijot. 
Dc- proct'leiu..!' iiiw«t het kind blijven onderviagen ni.b.t. het antwoord totdat 
dat dutdelijk la, ij 
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^. ; De profcfl eider plaatat een blad vpor het kind en legt eropj 



\ 



\, 



8 groene kubueaen en 1 gold cirkol (blj olkaar) • 



H.J .egt dai., ALLE DLOKKEN VAN HOUT ^IJN (Pl/ laat op blad geplaatata blokken 

zlen) t 

EN DIT IS HEM BLOK (Pi. laat gele oirkel ^Icn) 



DAN IS HET NIOT VAN HOUT (Pl. piaatot gele o^irkel buiten blad) 



. 1 



A KLOl^r DAT? • . ' • 

Ala het kifjd gecn atandiMird^itwoord gwft, %U OpBexiriii^ 1. 

Uanneer bet kind een etanda^rd^antwoord hocft ffegevon, yrA*gt de pcoefloidert ' * 

B WAARUH ZEO JB DAT? » • ' .• = w 

Zie 'n'iivrKt'-*: " tr.b.t. hot imtvoard, '. 
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-FORM PW- 



Proiiwntal lo: Cohcul-Coricrebt 
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Do pro«ilcidor heutt tw«c buJdcuiu Dci^ ^ne bak (a) b.vat 10 verschiUende 
kXoiiiu beeldjeo van dieren (waarondej. 66n hond) die at randora neergezet zijn. 
Do undere bak (b) bevat veracheidene e.roene kubuseen van 2.5 cm. 
Er ia 6€n hond en een nieWekleu,;d bl0kje van 2.5x2,5x8 cm die buiten het 
ijQZichtBveld van het kijid worden gehoud^n. 

■ \ • 

De fine hond in do bak komt apart te Bta.m.van 'le andere 9 dieren. 



\ 

De mogelijkheid bestaat dat het kind, vooral in de jongere leefti jdagroepen, 
niet weet wat het woord •kubuo' betekent, De proefleider moot er daarom naar 
vregen en eventueel uitleggen. 

Wanneer je het kind een object (hond, kubus) laat zien en je ontkent het (Bit 
ia geen hond, goen kubus), bedoel je: laten we ijiet doen alsof. 

"Kuii jo pa i«*r ovsr v?)rUilic3i?** 

««UtvrticH»fi vca. hf»t kind i« dfci kliid MOMiJaliw mc 

WOSdMI hO« &• vnM« bOMtWOOffd lfOld4HU 

y 

maiea hirl kind 4« iMtnu^tU. im A.B,c,fl of E aut bMriJpt. >irin»ir hot 
or dco MUA Mfti 0r ffm««0d vomit. 

BijvP03rt>*«Xd| d« i^K^sid^r Md*^ ^rvM^t w hat kind iiohijat 

t« antwooitUn tt«wt, d* ¥»lidit«it (of h«t klop^ of dim h«t 

Veiimjd, nadttt het kind antwoord gogevon heeft, uitoprakon als: "Dat ia 
een good oiilwoord", Boter is met iioaoer een uitupraak t.e doen m,^., t. de 
juiutheitJ van hot antwoord, fnaar moor goricht op hot feit dat iiet kind 
good zijn beiit doet, zoala bijv. "Je doet het good", "Mooi «o|«% od. 

84 



Wil je dat venier uitlotrirun? 

Vertel er eeua inotT over, 

Kun je me er aeor over vertellen? 

Waarom a eg je dat?* 

Mat bedoel je? 

g^Te antwoor den QpHjk ue^t het niPt»« 

a) Herhaal du vraag 

b) Weet je wat P is? Qia? 

indien '•nee"-.slopl 

indien -ja" - horhaal de vraa^ 

c) "Ik weot het n.et"- ,a venter .net hot vol.ende ite.. 
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-FORM CA- » 

f 

aXe* «Xiat li« uo«d ftatwoord", GQ«n ulfc«vr&ak duu o.b.t, | 
<i3 (on)Julatii«ld ve.n Hat aiit<»oord, aaar oou uitaprook gerlcht 
op hot foil da t hot iclnd.gcod ulja host doat. eocJIo MJVe ' | 

•'Ja doot ii«t good", •♦Mool no:", od. . | 

2) Hot prUolp« d«t d« pr"oori«ld^»r otMdl in'do eftt(»n eo7t*"li^uJon " 
^ blj ondonrraglns van hot kind la dat het gooa oanwl^Bls?^ 

^fiovoo (aa« wordoo hoe do vxi;*^ Wontwocrd coot i^j?doce 1 
Adloa hot kind, do inetruotloo A at D nicly UcTJL^vt, V,zvii:non 
\) Hot dan (uui wcnib «r covrc^i^^d uordt. 

V) iio proollelaop moot hot kl/id ortoo oanfi7t;t«o re^.&mn ZTcov^xu 
k;aj£cio vrcv^jcn co meof to xjoton to kofion ovojt hQt riTitvbcjf^. 
hot Jiljiii 

« 

«W11 Jo dat vorder ulticfeUion?% "Vox'toX ci' cguo kcw ovor.'"(» 
"waaron ee« Jo dat prooloo?** of -Wat bcdpol Jo da^jriio©?«, ' 
T) Vtat""or Jodaan^apo^ woraon*"na aotwoord'"-Tk"'\s(«et hot StotT"! 

a) horhaal do rpaag; Indlon hoteolfdo antwoordi 

b) "Woet Jo wat P la?", "wout Jo wat ^ la?"; Indloa -Weo."i 
atop mot do vraaij to atolloni Indian "Ja.'U horhaal do 
vrad^ nofe oen koup; Indien "Ik weet hot nlot.»»j 

c) otop oiot de vraati to atoUon on Terdor aot luit volgoado 

ItOUi* 
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Orade^ 



School 



Exaiftlner 



Scorer 



FORM CA 




C&t080ri<8 of 

Bhcplanat ion 



1 Verbal 
Dof icita 



2 Memoiy 
Deficits 



I 3 Arbitrary 
i ti:^planationa 



Place reapouDO to Byllogiam 



(,,e. no, »=,b,) box corrospondi^ to explanation, and olroU correct recponaee. 
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SCOHWa INSTRUCTIONS FOR 
CODIMQ FORM CmL 



I, g.«ral. th...co„. Will ,l»ce a che.k. i» the bo«3 where the kl^d 
of .t.t««nt the chtld .«.d. IB rej^eaehted at the top of the col«»«. For 
^U.. If the child eaye. 'Bog. ^ »i«aU are the thi^.", oUecla 
rtould be placed in the P-Q col«^ and the P« colu«. " Z^** 
-ould *. place in the P.Q colu«. heoauee the child recosi.e. that both- 
» ..d 9 «m exiet at the eame ti»e. The epeclf ic oriterU to »e. with 
.crl.,, ^ coi™ are listed helow. The o»ly violation to th. oheclt 
pl«.«nf in a ooW i. that if the child revereee in M» 

„.,on... place B In the appropriate colu«ui inatead df a check. 
tor «m>l'. if the major premiae aaye. -Ul P «• 9" 

-There are 4. and there are P.". Since the child .aid that , and P 

Tut in hi. «..w.r. w. Bcore it ae P,«, place an 8 in the colu« 

C.U., of the 'rSrersal. More than one cclu« can he .cored ( W>r H) for 

each item* 

2. The throe sections of euch iteu, that have aev.eral-word respon«ee are 
Bcored/Each section has a line on the,- form. There are two fo^nsy one for 
Parts I and III, and the other for II and IV items. 

3. The meanings of tho sy.:,bolu m each colmon is as follows: 
A, Class Relationshipa 

a) P-Q : R-aponoc indicutc. P..n.i Q are the sam^ in number or^ei.e. 

" ex: •^hey aVe-the uamc". "Thore are dogs and there are anirvalsj. 

b) P<Q : There are more Q than P« 

c) P>Q :. There are more P than Q.^ 

d) ^XS)* P'^*^ ^ exist as isoparato variables. 

ex: "There are dogs and there arc anirnal.-. -\ thii^ i» either a 
tree or a piasit?. 

e) : p imd Q are the same. 

ex: "All doga f . « animuis and all animaiy are dogs"* 

f) (ggj. There is some overlap ^^etween P and Q. 

ex: "Sotoe dogs animals". "Some a»tiioals are dog..". 
«) • P exists as a aubclaos of Q. 

^ "A dog is an animal". " • ■ >g9 anixaals". 



h) (^P) ; Q is a subordinate group to P. 

ex: "All aniWiJls ax-© dogs" i'* An animal is a dog". 

i) Other: Put a eymbolfor an other kind of responae tha+ needs to 
"be recorded. Iri th& notes area below, the oyinbol should be ex- ^ 
plained. lR)r.:"Th6re are dog?3*». This would be scored P orily_. 

Bv Log'ical Relationships , 

a) P ? Qnly the existence of P is recognisied. 
ftx:'^here is a dog"<r 

b) Q : only ;the existence of Q is recognized. 

exs 'There are plants*'^ «v 

c) T : only ^ho existence of the negative of P is recognized^ 

iiXi "There is no dog". "This not a ball". ■ %- 

d) 15 : only the existence of the negation of Q is recognized. 
'~ ex : 'There is no animal." 

e) PaQ t The existence of both P and Q is recognized. 

ex ; "There are' dogs and there are animals.", "You said all dogs 
aro animals", "Animals can be dogs and dogs can be animals." 

f) T.Q : recognises that the negation of P can exist while Q exist, 
ex : "The.re • is no dog; but there are animals", "All dogs are 

' animals, but not all animals are dogs." 
It Cian be inf ..-ed from some answers that ,P Q is intended, 
ex : "Every dog' must be an animal too.", implies that animal is 
eupex'Ordinate, and animals can exist that are not dogs* 
e)^^S • recognizer? that the iiegation of P and Q can exist at the same 
tlme« 

. ex ; ♦There are no "dogs or animals*" 

This, answer oan als6 be inferred from correctly applied implication 
or other answers in which P. Q is not stated directly. 
' ex :"A11 dogs are animals, but not all animals are dogs.", "If this 

is a dog, than it must be an animal, because all dogs are animals." 
"If this were not a dog, it might or might not be an animal." 
h) (P.TJ) s says that P can exist even when Q does not. 

ex t "There are no round things, but this is a ball anyway.", •'Thin 
is © dog but not an animal." 
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N(P»q) : denies that P and Q can exist at the sama time* 

ex: **There are no dogs that are not animals"* 
This can sometimes be inferred from a good implication response , ex: 
"This dog must be an animal because all dogs are animals*' 

P'i'R 

means that a term was added* For example, "all trees are green 
and all plants are green so this must be a plant*" 
Other: Mark any other kind of response that should be recorded 
(dealing with logical understanding) with a symbol and explain 
the symbol at the bottom of the psige under "notes"* . 
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^FORM CA- 
C^h Coding Form 

BxamiAer 

Tap e Scorer 
■ Iteite score d 




^RM PW- 
C~L Coding Form 



10 



Name^ 
Tape 



Examiner, 
Scorer 



Date scored 



Pa'rt I III (circle) 
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Logi 
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.cal 
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Rcl£ 
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